I don't know, but he admitted ... stealing ... (steal) things in our neighbourhood.

I don't know, but he admitted stealing things in our neighbourhood. (using the -ing form after 'admitted')