Carboxylated cellulose nanofibers (CNFs), having an average width of 7 nm and thickness of 1.5 nm, were produced by TEMPO (2,2,6,6-tetramethylpiperidine-1-oxyl radical)-mediated oxidation method. The fiber cross-sectional dimensions were determined using small-angle X-ray scattering (SAXS), transmission electron microscopy and atomic force microscopy techniques, where the rheological properties under different concentration and ionic strength were also investigated. The formation of hydrogel was evidenced by increasing the CNF concentration or ionic strength of the solvent (water), while the gel structure in ion-induced CNF hydrogels was found to be relatively inhomogeneous. The gelation behavior was closely related to the segmental aggregation of charged CNF, which could be quantitatively characterized by the correlation length (Ο) from the low-angle scattering profile and the scattering invariant (Q) in SAXS.