Fall of Saigon was born in 1981 when Florence Berthon (vocals), Pascal Comelade (organ, synthesizer), and Thierry Den (guitar, vocals) met at a concert in Montpellier, France. They chose to name the project Fall of Saigon after a song by UK post-punk act This Heat. They self-released their debut EP in 1983, citing Nico & The Velvet Underground and Suicide as influences.

At the time the band formed, Pascal Comelade was an accomplished musician with instrumental sketches composed for the trio. The six songs on the EP were recorded in two stages. "She Leaves Me All Alone" and "On the Beach at Fontana" were sung by Thierry and recorded at Pascal's home on a Revox 2-track in one take. The four songs sung by Florence - "Visions", "Blue Eyes", "So Long", and "The Swimmer" - were recorded and mixed at the Montpellier Languedoc Video Animation Center by Jean Alain Sidi on two Revox A77 reel-to-reels and a small mixer. On "Visions", "Blue Eyes", and "So Long," the group employed a drum machine that could only play four or five rhythms with a single slider to increase or decrease the tempo. The songs were minimal, with just a verse and chorus and no bridge or intro. Built on a simple spine, they create a feeling of space with just a voice and an organ or synthesizer melody. Full of class and inventiveness, Fall of Saigon are often compared to Young Marble Giants due to the fragile, ephemeral quality of the songs. Fall of Saigon only released one EP, and 30 years later their subtle sound is an essential guidepost in post-punk history.