Safety in Machine Learning and Artificial Intelligence is a very active research area. For a quick introduction to the subject in bite-sized chunks I strongly recommend to follow the work of Robert Miles. After gaining popularity in Computerphile videos he has now his own YouTube channel.
Computerphile compiled a playlist about AI and Rob is producing a very interesting video series about a paper on concrete problems in AI safety here.