PARTS OF THE PROJECT REPORT:
- Service One line description:
The smart mirror provides an interactive interface to the customer to enhance his shopping and in particular, his trial room experience.
- Service Abstract :
Retailers selling apparels find this best to allure customers who prefer to try-on clothing before making a purchase. The smart mirror captures the customer picture and videos. It then displays alternatives side by side with the clothing they are trying. This saves the customer physical exertion of trying the clothes and running around the store to pick up other items for trial. Nevertheless, this has been boosting sales.
- Service Context :
The usage context for the Smart Mirrors is shown as follows. The basic use of it that customers in the shopping sites could try various clothing on them without actually wearing it, they could select any color that they would like to.
Fig: Servicecs in Smart Mirrors
- Human Interference:
No human interference is involved to carry out this operation. We are setting up GUI which serves as an application interface between the mirror and the user, it scans the barcode of the dress, retrieves the information from the database that we had set up in cloud. This information is displayed on the LCD.
FUNCTIONAL VIEW SPECIFICATION:
The overall goals of this experiment is multifold, they are mentioned as follows:
- Scan the barcode of the dress using Barcode scanner that is mounted beside the mirror.
- Using Image Processing, changing the color of the dress to the desired color of the customer.
- Set up a code to generate QR code such that the customer could actually download the image of him/her using the application on the mobile
- We have an idea of fixing bulbs on the mirror so that it will change the colors as desired and selected by the customer.
- Capture the image of the customer using the camera module on the Pi.
- We would try to create an application GUI which displays the barcode information when the user tries to click, to generate barcode, this is actually the fusion of both GUI and barcode scanner together for a better user interaction in the trial room.
- When a customer scans a hand tag the information about that item that is stored in the database is retrieved (ex. other colors of that item available, other sizes available). We create another database to save the the items the customer tries.
The target user for Smart mirror is for all age groups. It is useful for everyone who wants to try their outfits with more comfort rather than trying all the possible clothes that they could. Retailers selling apparels find this best to allure customers who prefer to try-on clothing before making a purchase.
Our project is divided into 5 phases.
- 1st phase: Firstly, we’ve set up LCD monitor and a mirror. We have installed all the required libraries for the LCD after which the display works when connected to the Raspberry Pi.
- 2nd phase :
- In the second phase, we have set up the camera module on to the Raspberry Pi to capture the image and to scan the barcode of the dress that the customer would wish to.
- We’ve mounted a bar code scanner near the mirror which captures the barcode of the dress and returns the details regarding that on the mirror.
- 3rd phase :
- We have written code introducing Image Processing in to picture upon which the color is detected and also changes to the required color.
- We have tried to set up GUI application that serves as an interface w=for the barcode scanner information.
- 4th phase :
- Next, we have decided to store all the information in the database to retrieve whenever a customer scans the barcode of the dress. We are also storing the database in cloud for advanced speed and agility. For this we are using and cloud to serve the purpose.
- We’ve used LED’s on the bread board and bulbs are placed on the sides of the mirror so that it will change the colors as desired and selected by the customer, this is for the customer to understand how that specific color looks without actually wearing it.
- 5th phase :
- We would try to set up a code to generate QR code such that the customer could actually download the image of him/her using the application on the mobile which was actually tried in the trial room with various colors
We’ve used the following tools for the project.
- Raspberry Pi.
- Highly reflective Mirror.
- LCD screen for display.
- Bread board with LED’s
- Camera module.
- Connecting wires.
Operational View Specification:
In operational view specification, various options pertaining to IOT system deployment and operation are defined, such as, service hosting options, storage options, device options, application hosting options, etc.
Functional groups to operational view specifications for the smart water filter can be mapped to IOT system as follows;
Devices : Camera module for capturing the images, Barcode scanner to scan the barcode, LCD display, highly reflective glass mirror and Raspberry Pi of course to get all these connected.
Fig: Operations Overview
Above picture shows the flow from start to end , explains the connection with each of the item that is involved in the project.
Application Management: Automatic
Database Management: We have used MySQL to store our database and that is placed in AWS cloud. We stored the customer database and also the information about the dresses like model, size etc. When the customer scans the barcode, the information is retrieved from the database which in turn displays on the screen. It shows whatever other colors and sizes that are available for that particular dress selected.
Device Management: Raspberry Pi, LCD display, highly reflective glass mirror.
Device and Component Integration:
In Device and Component Integration design methodology describes the integration of the devices and components. In this Smart Mirrors IoT project, the devices and components used are, Camera module for capturing the images, Barcode scanner to scan the barcode, LCD display, highly reflective glass mirror and Raspberry Pi of course to get all these connected.
Integration of Pi with Display and GUI:
We have used the 10 inch LCD HDMI touchscreen display by Waveshare. It comes with a manual to set up and the instructions in the manual are not very clear. It took us quite a lot of work to figure out the set up.
After setting up the display, we create a Graphical user interface using Tkinter Libraries in Python. We have used python 2 to create the application with widgets, labels to display information, drop down menus and buttons to perform actions. The GUI piece of code is
Integration of GUI with Camera Module: To install the camera module and make it work as a barcode scanner we referred the following link:
We install SimpleCV, which is a framework for open source machine vision. With the help of this we can capture images, stream video, etc.
We install the zbar library to detect barcode information. The camera module scans the barcode, from which information is retrieved using the zbar library.
Integration of Camera Module with Database: We create the mySQL database that stores details of the Inventory.