Information for Participants

Purpose of the Research?

This study is part of research project titled Data-Center Audio/Visual Intelligence on Device (DAVID). The aim of this research is to build an Artificial Intelligence Platform (AIP) for a new generation of Privacy secured smart toys.  This platform will enable smart-toys to understand human speech, recognize their owner and their parents and interact with them through speech and tactile interfaces. This will be achieved through an AIP that does not send any personal data to a cloud service, thus ensuring that any speech or video data captured by the smart-toy remains secure on the device.

In order to build algorithms for the DAVID AIP training data is required, in particular advanced 3D face and body models are used to simulate a range of human actions, gestures, expressions and activities. Data from these simulations are then used to build large 2D datasets that are used to train the AIP.

Our industry partner, Xperi, will use this data to build intelligent new smart-toys that can interact more naturally with children and their parents. This research was partly inspired by the Stephen Spielberg film: https://en.wikipedia.org/wiki/A.I._Artificial_Intelligence

What type(s) of data will be collected?

The 3D scanner used in this data acquisition is a photogrammetric scanner. It collects a series of high-resolution photographs of people or objects placed inside the scanner and processes these to build a sophisticated 3D model of the subject. This model can be further processed in a specialized 3D software framework to rig and animate the model. This data is referred to as ‘research data’ in this document.

Xperi, our industry partner in this project, has developed the software to process and create these 3D models and uses additional algorithms to animate them to perform a range of human actions and gestures. In addition to photographic data, we may also request to acquire some speech data which will be used for the same purposes.  

A picture showing the physical form of the scanner is shown in Fig 1. below and Fig 2. of the information sheet and shows a number of views of the final 3D model generated by the scanner from the 2D photographic images captured.

How is your data stored, processed and utilized?

Models and data will be stored and anonymized on secure internal servers at Xperi. It will be processed by researchers at the company using advanced 3D software tools to build training datasets for Xperi AIP platforms. Your data will not be used in products developed by Xperi, it is only used to improve and test the algorithms that program these products. This research data is stored in digital form using an identifier such as “subject X23-12345”.

Your personal contact information will be stored separately and is only linked with the research data you provide today through a subject ID number, such as “subject X23-12345”. Some subject-specific data such as age-range, gender, ethnicity, height, weight, and other physical attributes may be saved with the research data but is not considered personally identifiable data.

Note that we are required to retain your contact information by GDPR regulations in case you later decide to withdraw your consent, or it becomes necessary to inform you in the unlikely event of a data breach. This is why we must keep the indirect link between research data and personal contact data.    

Xperi may also use the anonymized data and models to test and validate algorithms for AIP systems in other company products such as occupant monitoring systems for cars. The data and models derived from 3D scanner data will only be used for internal research at Xperi. No data, personal or anonymized, will be made publicly available. More details are provided in the consent form you are asked to sign. 

What is your part in the research?

You will be required to come to a location at NUIG at an agreed suitable time on a single occasion for a maximum of 30 minutes. On the day, you will be asked to sign a consent form and will have an opportunity to ask questions. You will be shown the 3D scanner and there will be a demonstration of what you are required to do during acquisition. The acquisition is expected to last about 20 minutes.

What are the risks?

There are no risks to your health, safety or well-being through participation in this data acquisition. Data is acquired using conventional DSLR cameras. These are similar to the camera in your smartphone or in a consumer digital camera.

Your identity will not be linked directly with the image or speech data we collect or the 3D model that is generated form this data.

You are providing personal biometric data, more specifically facial image data, but this will not be retained or stored. Instead, it is used to build a complex 3D model that requires an advanced software environment to access or process. This model is not directly linked with your personal contact information provided in the consent form.

We will only use the research data for training and validating improved AIP algorithms. Data or models will not be directly incorporated into products or software distributed by us thus the primary risk is due to a data breach by 3rd parties or equivalent criminal behaviour.

In the event of a data breach, it is unlikely, but possible that both the research data and your contact information data are obtained by a 3rd party. If such an event were to occur there is a risk that this 3rd party could reconstruct images of you and employ this data in a spoofing attack using your facial biometric data. However, it would be much easier for a criminal 3rd party to obtain facial image data from a social media channel or personal web page to achieve the same end.

Note that a detailed Data Protection Impact Assessment (DPIA) has been carried out for the 3D scanner used in this study in consultation with the Data Protection Office at NUIG and legal representatives at both NUIG and Xperi.  

How will I benefit from participating in this study?

By taking part in the study there is no direct benefit to you. It is hoped that information obtained during the study will be useful to improve the capabilities of new AI-enabled smart-toys and occupant monitoring systems in autonomous vehicles. We will compensate you for your time spent in reviewing the documentation associated with this study and in participating in the data acquisition process.   

How should I explain this research to my child?

Each child has their own understanding of technology. Some are very familiar with the Internet and may even have their own personal device or VR headset. Others may not be so familiar. As a parent you are the best person to explain this study to your child. To assist we have provided a child-friendly information sheet explaining the DAVID project and how we will collect and process the data in this study. It is recommended that you read through this information sheet (for children) here carefully with your child and watch the video (available on the website below).
There is also a research protocol (for children) document here that explains what will happen in the laboratory and aspects of the consent form in child-friendly language. We recommend you also read through this with your child prior to coming to the laboratory.
If you still have questions, please reach out to any of the investigators for further information about this study. On the consent form you are asked to confirm that you have read this information sheet with your child and that you have allowed a 7-day period for reflection prior to taking part in this study. This 7-day period is recommended as best practice for child participants.

What if I do not want to take part?

You can discontinue your participation in the research study at any time. Should you feel at any stage that you want to discontinue being a participant in the study, then this is dealt with in an unhesitating and confidential manner where you have the option of withdrawing from the study without the risk of information being disclosed.

Your identity is contained in the Consent form which will be kept in a secure location, separately from your biometric data, and only the lead PI will have access to your personal data.

Who is responsible for executing this study?

Principal Investigators:

Prof. Peter Corcoran, College of Engineering & Informatics, NUIG.

Contact Prof. Peter Corcoran

Other Investigators:

Dr. Claudia Costache, College of Engineering & Informatics, NUIG.

Contact Dr. Claudia Costache

We would like to remind you that taking part in this research is completely voluntary. If you decide to take part, please be aware that you can still withdraw at any time and without giving a reason. Your rights will not be affected in any way. If you decide to take part, please sign the Consent Form. This Information Sheet is for you to keep.