Well, we all have to start somewhere. Personally, I think that a desire to learn outside of your classroom is a healthy impulse.
If you are looking for specific books to read, there are a few that I can recommend. Some of them may be a bit difficult, depending on your level of background in math, physics and EE, but go ahead and challenge yourself--There's no better way to learn.
First, I would start with this:
Handbook for Sound Engineers: The New Audio Cyclopedia
by Glen M. Ballou
http://www.amazon.com/exec/obidos/tg/detail/-/0672219832/qid =1103523885/sr=1-1/ref=sr_1_1/002-2705562-1947214?v=glance&a mp;s=books
Not a great read but an essential reference. Then I would try to tackle this:
On the Sensations of Tone
by Hermann Helmholtz
http://www.amazon.com/exec/obidos/tg/detail/-/0486607534/ref =pd_sim_b_3/002-2705562-1947214?%5Fencoding=UTF8&v=glanc e
Still, perhaps the best book ever written on the science of music. Then try this:
Science and Music
by Sir James H. Jeans
http://www.amazon.com/exec/obidos/tg/detail/-/0486217698/qid =1103523953/sr=1-1/ref=sr_1_1/002-2705562-1947214?v=glance&a mp;s=books
Then one of my personal favorites:
Music, Physics and Engineering
by Harry F. Olson
http://www.amazon.com/exec/obidos/tg/detail/-/0486217698/qid =1103523953/sr=1-1/ref=sr_1_1/002-2705562-1947214?v=glance&a mp;s=books
These are the classics, and if you can get through them you will have a good foundation in the basics. Then I would read:
Master Handbook of Acoustics
by F. Alton Everest
http://www.amazon.com/exec/obidos/tg/detail/-/0071360972/qid =1103526134/sr=1-1/ref=sr_1_1/002-2705562-1947214?v=glance&a mp;s=books
Then:
Music Engineering
by Richard Brice
http://www.amazon.com/exec/obidos/tg/detail/-/0750650400/qid =1103525890/sr=1-1/ref=sr_1_1/002-2705562-1947214?v=glance&a mp;s=books
Then finally, you will be ready for this:
Principles of Digital Audio
by Ken C. Pohlmann
http://www.amazon.com/exec/obidos/tg/detail/-/0071348190/qid =1103526043/sr=1-1/ref=sr_1_1/002-2705562-1947214?v=glance&a mp;s=books
This last one may be a bit more difficult, but it will bring you up to date. Good luck and good reading.