I don't understand the confusion with gender neutral pronouns

As a non-native English speaker who learned English at a young age, I was taught that they/them was both a singular and a plural pronoun. So, I've always referred to everything/everyone as they/them for simplicity and mainly because I hated using he/she or him/her. Seeing so many people insist that they/them is only plural is making me so confused.