Applying machine learning to problems has become an avoidable trend. With the help of machine learning techniques, people can make predictions more accurately and can get more benefits. However, the machine learning technique relies on training from lots of data. That is, data should be open to the machine learning service provider. Considering the user privacy issue, the release of user data is not acceptable. In this paper, we propose an approach to take care both the machine learning feature and the data privacy. We focus on audio data and propose an audio encryption technique to keep audio data credential. In the meantime, we make the encrypted audio be able to be trained though machine learning service providers.