The advancement in technology has made their scope much broader then before by taking these technologies from industry to home and daily usage application. This paper presents the architecture of universal remote based on mobile phone. Proposed system provides facility to users in order to control their home appliances using spoken command. System has ability to recognize speaker and speech which limits the access to only authorized persons that can interact and control the home appliances. The main purpose of this method is to merge both technologies bring them on a single platform to facilitate severely disabled, low vision and older person. The focus of this research is to provide a universal remote which can easily control remote control appliances using voice command in secure manner