After people in Nazareth marvel at Jesus' words, they ask, 'Is not this Joseph's son?' The question is not a request for genealogical information. They already know the family with which they associate him.
Familiarity becomes a framework for deciding what kind of person Jesus can plausibly be.