Prior work has generated sentences that describe 2D images (Farhadi et al., 2010;Kulkarni et al., 2011;Karpathy et al., 2014) and referring expressions for specific objects in images (FitzGerald et al., 2013;Kazemzadeh et al., 2014).
generating scenes is currently out of reach for purely image-based approaches.