Harnick was born and raised in Chicago and earned a bachelor's degree in music from the Northwestern University School of Music after serving in the army during World War II. Trained in the violin, he decided to try his luck as a songwriter in New York.