Alongside his second wife Yoko Ono, he formed the Plastic Ono Band in 1968 and the couple released two editions of experimental tracks called 'Unfinished Music' in 1968 and 1969 respectively.