The incident happened at around 2.15am on Thursday, September 16, when a man was seen loitering in the area of Howard Street.
At around 3am he entered a property on Howard Street and then was seen leaving a short time later.
Nothing was stolen.
Investigating officer PC Emily Stoker, based at Oxford police station, said: “I am appealing to anyone who recognises the man shown in this CCTV image to come forward.
“The circumstances of this incident are concerning and I believe the man pictured has information that may prove vital to this investigation.
“You can contact us using our online form or by calling 101 with reference number 43210419949. Alternatively, you can contact the independent charity Crimestoppers anonymously via their website or on 0800 555 111.”
For news updates straight to your inbox, sign up to our newsletter here.
Have you got a story for us? Contact our newsdesk on [email protected] or 01865 425 445.