Most likely the jazz/big-band song associated with Captain America scenes is “It’s Been a Long, Long Time” (often heard in WWII-era/romance moments connected to Captain America).
It's Been a Long, Long Time
Harry James and His Orchestra (with Kitty Kallen)
Listen on
Music Video