It depends on the person. My friend's daughter loved remarks on her height. I don't visit often, but every time I do, I'd comment how she's grown and she'd brag how she'll be taller than me by the time she's 10
. Now that she's a teenager, it's our inside joke.
I wouldn't say it to a person I don't know as well though. However, "How you've grown" or "You were just a baby the last time I saw you" is just a thing to say just to make small talk to break the ice. It may be eye-rolling for some, but for me, I don't even remember it after a few minutes when it was used on me as a kid.