Found in Version:
Taking anything from the Mages Guild Supply Chest in Old Ebonheart is considered a crime.
I joined the Mages Guild in Balmora if that matters. The other Mages Guilds chests don't seem to have this problem. I've definitely tried Balmora, Akamora, and Firewatch Palace.