Among the many attractions in this year\u2019s Canadian National Exhibition (CNE) in Toronto are\u00a0the sights and sounds of\u2026 proteins.<\/p>\n
John Bonnett, an associate professor in the Departments of History and Interactive Arts and Science, will be displaying his DataScapes project as part of an augmented reality exhibit created by Brock University, York University and the University of Toronto.<\/p>\n
\u201cIn some ways we got a really lucky break with Pokemon Go coming up; augmented reality is very much on peoples\u2019 minds now,\u201d says Bonnett. \u201cWhat this exhibit will do is to show that there are other ways of using augmented reality beyond gaming, including art.\u201d<\/p>\n
Bonnett first unveiled his DataScapes project during Congress 2014 held at Brock.<\/p>\n
The project consists of two pieces: The Five Senses<\/em>, and Emergence<\/em>. The first work presents music and images derived from proteins involved with the five senses: sight; touch; taste; smell; and hearing.<\/p>\n When viewers point their phone or tablet at the QR code, they will see a hovering floating cube and monoliths surrounding the cube, Bonnett says. In addition to seeing the images, people will hear music based on patterns derived from the protein data.<\/p>\n Bonnett and colleagues obtained data from the National Institutes of Health in the U.S. To generate the music and visual art in The Five Senses, Bonnett and his team started with the amino acid data contained in each protein record.<\/p>\n Each amino acid constituting a referenced letter was represented as a letter. The research team converted the letters into numbers, starting from A equaling 1 all the way to Z equaling 26.<\/p>\n Student composers in the Department of Music aligned those numbers with a musical scale to produce raw music strings. The composers then fashioned those sounds into a musical piece.<\/p>\n To produce the images seen in the cube, colleague Bill Ralph with the Department of Mathematics used the same numbers to create an algorithm that converted the numbers into images.<\/p>\n For the second piece, Emergence<\/em>, Bonnett and his colleagues used a text dataset as the basis for the work\u2019s sound and images. Bonnett isolated passages in the Holy Bible and gave the text to the student composer, who turned the letters into numbers and then converted those numbers into music strings to make a music composition.<\/p>\n Computer science student Chris Jacques worked under the direction of Michael Winter, who initiated development on the project\u2019s app, which was then completed by Mark Anderson and Joseph Bolton from Edge Hill University in the UK.<\/p>\n DataScapes will be one of three augmented reality projects at the CNE. It will be featured with contributions from the University of Toronto and York University.<\/p>\n \u201cI was invited to participate,\u201d says Bonnett. \u201cThe invitation can be taken as an indication that Brock University is seen as one of the leading universities in the province with respect to exploring the potential of augmented reality to support a variety of applications, including art.\u201d<\/p>\n The CNE runs from August 19 to September 5. The project\u2019s app is available for free downloading from both the Apple App and Google Play stores.<\/p>\n","protected":false},"excerpt":{"rendered":" Among the many attractions in this year\u2019s Canadian National Exhibition (CNE) in Toronto are the sights and sounds of\u2026 proteins. <\/p>\n","protected":false},"author":20,"featured_media":40604,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[3319,4052,37,41,4,5],"tags":[4399,4397,4398,4402,1928,263,356,549,1671,3976],"_links":{"self":[{"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/posts\/40603"}],"collection":[{"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/users\/20"}],"replies":[{"embeddable":true,"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/comments?post=40603"}],"version-history":[{"count":1,"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/posts\/40603\/revisions"}],"predecessor-version":[{"id":40605,"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/posts\/40603\/revisions\/40605"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/media\/40604"}],"wp:attachment":[{"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/media?parent=40603"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/categories?post=40603"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/brocku.ca\/brock-news\/wp-json\/wp\/v2\/tags?post=40603"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}