One of my earliest memories is with a kid's phonograph (mono of course, and I used it to do weird things, like use the rotation to wind a sewing thread to pull things - move over, Calvin). "The Bear Goes Over the Mountain" was on repeat, by hand, of course.
Must have driven my parents crazy, but hey, they bought it for me.
Later, my parents had a small stereo that I would wake up early in elementary to listen to their RCA Collection of Greatest Music (Wagner waltzes, Beethoven, and pop hits like "Moon River" and "Yellow Bird"). But it was at an aunt's house, who had a piano, that I would "play" by making sounds like wind or a rain storm without any training at all, that made my parents realize I might benefit from piano lessons. I was a slow study, since I was a little older than most (12, I think, and my teacher would "tch tch" that I started too late). Not having a piano hurt; how could I practice? So they got one for me, and a guitar for my brother. He later abandoned the guitar and so I got it and a simple chord book and taught myself (I still play the guitar "like a piano").
By high school I had gotten good enough to do recitals on piano, but by that time the local radio and the greatest hits of the 60s and 70s had everyone wanting to be in a band. Not for me, I would use my cassette recorder and make up stuff. Now retired -- and still doing it! Piano lessons gave me a love of classical, the Beatles gave me a love of pop, and King Crimson sent me on the way to the obvious prog / jazz. I never developed a deep love of the blues, though, surprisingly, since the Delta wasn't that far away, but it was a bit too simplistic a formula for me, not that I couldn't rock to it at times! You had to do so until prog came along, though, as most of rock was blues-based.