Purpose Lymph node metastasis in papillary thyroid cancer (PTC) occurs 40–60%. Extrathyroidal extension and large tumor size are most reliable predicting factors for central lymph node metastasis whose prognostic value is controversial. In this study, we evaluated the relationship between a specific finding of primary tumor in the thyroid, fibrosis, and negative prognostic factors. Materials and methods We reviewed the patients who underwent total thyroidectomy and central lymph node (CLN) dissection with or without lateral lymph node dissection (LND) for PTC, from January to December, 2011. We defined (+) finding when the degree of fibrosis comprises 10% or more of the primary tumor. Correlation between degree of fibrosis and negative prognostic factors, including age, gender, tumor size, extrathyroidal extension (ETE), number of CLN metastasis, and lateral cervical lymph node metastasis (LCLNM), was analyzed. Results Of the 481 patients, fibrosis (+) group includes 387 patients (80.5%). On the chi-square test, age, gender, tumor size, and LCLNM were not correlated with fibrosis. ETE (+) group comprised of higher rate of fibrosis (+) group (90.4%) compared to ETE (−) group (64.9%, p Conclusions Fibrosis in PTC can be a risk factor of extrathyroidal extension, a negative prognostic factor. This suggests that the behavior of fibrotic tumor is, possibly, more aggressive than non-fibrotic tumor.