Research trio advocate more work on AI security
What if someone hacked a traffic sign with a few well-placed dots, so your self-driving car did something dangerous, such as going straight when it should have turned right?
Don’t think it’s unlikely – it’s already happened – and an Okanagan College professor and his colleagues from France are among those saying that researchers have to invest more effort in system design and security to deal with hacks and security issues.
A research paper, co-authored by Okanagan College Computer Science Professor Dr. Youry Khmelevsky, and presented recently at an international conference held by the Institute of Electrical and Electronics Engineers (the world’s largest technical professional society), summarizes the research that has already been done into the threats and dangers associated with the machine-learning processes that underpin autonomous systems, such as self-driving cars.
Their paper also points to the needs to take research and tool development for “deep learning” to a new level. (Deep Learning – DL - is what makes facial recognition, voice recognition, and self-driving cars possible. Deep Learning systems mimic neural networks – like your brain – that can take data and process it based on information processing and communication patterns. For a good description of how artificial intelligence, machine learning and deep learning connect to each other and the role they play in our daily lives, see AI, Machine Learning, & Deep Learning Explained in 5 Minutes)
The paper was authored by Dr. Gaétan Hains, Arvid Jakobsson (of Huawei Parallel and Distributed Algorithms Lab at the Huawei Paris Research Centre) and Khmelevsky. “Safety of DL systems is a serious requirement for real-life systems and the research community is addressing this need with mathematically-sound but low-level methods of high computational complexity,” notes the trio’s paper. They point to the need for significant work yet to be done on security, software, and verification to ensure that systems relying on deep learning are as safe as they could be.
“It sounds very abstract,” says Khmelelvsky, “but it isn’t. It’s here today whether it’s in your car or a device that recognizes your voice and commands.”
"Deep Learning-based artificial intelligence has had immense success in applications like image recognition and is already implemented in consumer products,” notes Jakobsson. “But the power of these techniques comes at an important cost compared to ‘classic algorithms’: it is harder to understand why they work, and harder to verify that they work correctly. Before deploying DL based AI in safety critical domains, we need better tools for understanding and exhaustively exploring the behaviour of these systems, and this paper is a work in this direction."
Do Hains, Jakobsson and Khmelevsky have the answer to prevent hacks that could send your car going straight, when it should go left? Not yet, but they are developing some research proposals that could help ensure that your car, and its systems based on artificial intelligence, don’t get fooled.
“Safe AI is an important research topic attracting more and more attention worldwide,” says Hains. “Dr. Khmelevsky brings software engineering expertise to complement my team's know-how in software correctness techniques. We expect to produce new knowledge and basic techniques to support this new trend in the industry.”
Tags: Computer Science
TOP STORIES
RELATED STORIES
Sign up for weekly stories
Meet Ruth Gabriela Melo Flores
April 4, 2023
Q: What's your name? A: Ruth Gabriela Melo Flores Q: What's your hometown? A: Quito – Ecuador – South America Q: How did you end up at Okanagan College? A: Well, I studied for a bachelor's degree in Law in Ecuador. Then, I worked for a while and got my Master's degree in Government and Culture of Organizations at the University of Pamplona. When I returned to my country, professional opportunities arose for me. I mean, a Master's degree improved my career. Spain helped ...
Read more...Artistic students design future careers in animation
June 7, 2022
Grads of Okanagan College’s Animation Diploma program are finding their skills have never been in higher demand. First- and second-year students showed samples of their artwork and demo reels to industry partners at OC’s annual Animation Industry Night on May 17. “Lots of the work was very professional,” says James Wood, Chair of Okanagan College’s Animation Department. “Our program is short, but intense. The instructors make sure the students have a realistic understanding of what they need do to succeed in a competitive and demanding...
Read more...OC Business students embrace international study again
May 30, 2022
Business students from Okanagan College are once again able to travel to Jyväskylä, Finland to experience an international summer school at the JAMK University of Applied Sciences. Finland’s education system is widely regarded as one of the best in the world. OC Business Professor Blair Baldwin, who has taught Services Design at JAMK for several summers, says working in Finland has helped him innovate and create new teaching methodologies. “JAMK employs experiential learning across its curriculum,” he says. “They stress cri...
Read more...Enactus Okanagan College tops the field, sets sights on national championships
May 27, 2022
Okanagan College students will once again be competing for the Canadian title after qualifying for the Enactus National Exposition with a first-place finish in their league during the semi-final round. Enactus teams at post-secondary institutions across Canada competed virtually earlier this month, and Okanagan College scooped up top position in the TD Entrepreneurship Challenge, and runner-up in the Scotiabank Climate Action Challenge for the Unusually Good Food Co. project. It also included national runner-up in Shaw and RBC accelerator...
Read more...