Genesis 2 and Exodus 20 ground Sabbath in God's own rest and command.
Jesus' conclusion concerns the authority of the Son of Man over the Sabbath itself, not merely one minor interpretive detail.
Lordship over a divine covenant institution is an extraordinary claim and contributes strongly to Luke's portrait of Jesus' authority.