Nitrogen stress is an important control on the growth of phytoplankton and varying responses to this common condition among taxa may affect their relative success within phytoplankton communities. We analyzed photosynthetic responses to nitrogen (N) stress in two classes of phytoplankton that often dominate their respective size ranges, diatoms and prasinophytes, selecting species of distinct niches within each class. Changes in photosynthetic structures appeared similar within each class during N stress, but photophysiological and growth responses were more species- or niche-specific. In the coastal diatom Thalassiosira pseudonana and the oceanic diatom T. weissflogii, N starvation induced large declines in photosynthetic pigments and Photosystem II (PSII) quantity and activity as well as increases in the effective absorption cross-section of PSII photochemistry (σ'PSII). These diatoms also increased photoprotection through energy-dependent non-photochemical quenching (NPQ) during N starvation. Resupply of N in diatoms caused rapid recovery of growth and relaxation of NPQ, while recovery of PSII photochemistry was slower. In contrast, the prasinophytes Micromonas sp., an Arctic Ocean species, and Ostreococcus tauri, a temperate coastal eutrophile, showed little change in photosynthetic pigments and structures and a decline or no change, respectively, in σ'PSII with N starvation. Growth and PSII function recovered quickly in Micromonas sp. after resupply of N while O. tauri failed to recover N-replete levels of electron transfer from PSII and growth, possibly due to their distinct photoprotective strategies. O. tauri induced energy-dependent NPQ for photoprotection that may suit its variable and nutrient-rich habitat. Micromonas sp. relies upon both energy-dependent NPQ and a sustained, energy-independent NPQ mechanism. A strategy in Micromonas sp. that permits photoprotection with little change in photosynthetic structures is consistent with its Arctic niche, where low temperatures and thus low biosynthetic rates create higher opportunity costs to rebuild photosynthetic structures.