All posts tagged video game

  • Griffith Review essay: ‘Worlds Beyond: Teachable moments in virtual reality’, May 2017

    An essay for edition 56 of quarterly print publication Griffith Review, which is titled Millennials Strike Back. Excerpt below.

    'Worlds Beyond: Teachable moments in virtual reality' essay in Griffith Review by Andrew McMillen, May 2017Worlds Beyond

    Teachable moments in virtual reality

    The blue whale is only a metre or two away from me, and its huge right eyeball is level with mine. I have never seen the largest creature on Earth from this angle, at this depth, in these dimensions. Its body mass fills my vision, and I have to turn my head 180-degrees to take it all in. I’m standing on the bow of a sunken ship, and I have watched, enthralled, as this dweller of the deep sea approached from the dark-blue distance on my left. The surrounding schools of fish and graceful manta rays take little notice of the giant: for them, its presence deserves the equivalent of a submerged shrug; it’s something they see every day. But for myself, standing here on the ship, rooted in place in wonder, it is an extraordinary encounter.

    As it hovers before me, the beast blinks and emits a few curious groans before tiring of this underwater interloper. Just another human being. Boring. When it swims to my right in search something more interesting to look at, its tail-flukes almost lash me on the way past. In sum, I’ve spent only a minute in its company, but I feel as though quite a few things have changed. This is a fork in the road: my life can now be categorised as ‘Before Whale’ and ‘After Whale’. But perhaps the most astounding part of this experience is that it is running entirely on computer code. Even though every aspect of this scene feels real, it is not.

    After I watch the whale disappearing into the dark-blue distance, I turn around to see white text projected on the back of the sunken ship. It is a list of credits for the team of people who worked on this convincing simulation. It’s named ‘Whale Encounter’, and it’s part of a virtual-reality game called theBlu. In reality, you see, I’m standing in a tiled living room in New Farm, in inner-city Brisbane, wearing a headset that is attached to a powerful computer by a thick, black cord. The view from the balcony outside is filled by the Story Bridge. Beneath the steel structure runs the Brisbane River, where there are no blue whales, as far as I’m aware.

    Next, I use one of the wireless controllers in my hands to point and select ‘Turtle Encounter’. This is just as impressive as the previous immersion – and several minutes longer, too. In startlingly clear water, with the sun shining through the surface above me, I stand at the edge of a coral reef. A loggerhead turtle cuts a lazy circle above me, just out of reach. On my right, I’m approached by hundreds of football-sized bright orange jellyfish. Before long, these small creatures are accompanied by several enormous, man-sized giants whose tentacles trail behind them like windblown dreadlocks. Using the controllers, I can prod the jellyfish to affect their trajectory. It is simply gorgeous, and like the whale, it inspires a sense of awe unlike anything I’ve experienced while playing a traditional video game.

    When it comes to eliciting emotions, it appears that virtual reality is streets ahead of everything that’s come before. Moreover, it strikes me that this sort of experience could foster new understanding for children who struggle to process information that’s delivered verbally, or presented on a printed page. Any child can strap on a headset, fire up theBlu and take something away from the experience of feeling as though they are immersed underwater, inside a potentially dangerous and hard-to-reach part of the planet, while still engaging their minds in a way that a textbook, or even the most fervent educator, might fail to achieve.

    To read the full essay, visit Griffith Review‘s website and purchase edition 56, Millennials Strike Back. The image on the book’s cover above is credited to illustrator Laura Callaghan.

  • Backchannel story: ‘This Video Game Has Solved The Problem of Learning Guitar’, May 2015

    A story for Backchannel, the technology section of Medium.com. Excerpt below.

    This Video Game Has Solved The Problem of Learning Guitar

    I tried taking lessons. I tried reading guitar tabs online. The only thing that worked was Rocksmith.

    'This Video Game Has Solved The Problem of Learning Guitar' by Andrew McMillen on Backchannel, Medium.com, May 2015

    Music has long struck me as a kind of magic. In terms of my life essentials, it ranks only just below oxygen, food, water, shelter and love. For 11 years I have been attempting to conjure some of that magic myself by learning to play guitar.

    Yet for most of those years I practiced fitfully, and at some point I stopped improving. When my progress plateaued, so did my enthusiasm. Despite the pleasure I derive from watching a person with a six-string plugged into an amplifier, plucking and strumming to elicit beautiful noise, I seemed destined to never fully master this iconic instrument.

    But then I discovered a video game that rekindled my obsession. It’s calledRocksmith, and it is designed specifically to teach people to play guitar. Earlier games, namely Guitar Hero and Rock Band, had shown that tens of millions of people could become hooked on playing fake, simplified instruments while fake, simplified musical scores scrolled down their televisions. After clocking in several jam sessions, many players even began to sound competent. But that expertise evaporated the second the game shut off.

    Laurent Detoc, the North America president of Ubisoft, a game development studio, hated the gulf that separated actual and simulated musicianship. In 2011 he told the San Francisco Business Times, “I just could not believe the amount of waste that had gone in people spending so much time with plastic guitars.” His company had assigned some designers to figuring out how to make playing real guitars just as fun for gamers as jamming on a plastic replica. What they came up with is, to my mind, the purest demonstration of the power of gamification—using the principles of game play to make actual learning feel addictive. Case in point: I’ve learned to play more songs in two and a half years with Rocksmith than in the previous eight years of lackluster progress combined.

    My attempts to learn guitar followed a path familiar to many teenage rock enthusiasts. They began with an acoustic guitar my parents gave me in 2004, for my sixteenth birthday, and weekly lessons with a tutor. My teacher—a bookish, chubby, middle-aged man who looked nothing like Jimi Hendrix—was prescriptive in his instruction. He told me that my left thumb mustremain pointing skyward against the back of the neck, regardless of the notes or chord shape required. This dictum puzzled and infuriated me, as none of the popular musicians I’d seen in music videos were so staid in their playing; rather, they were fluid and catlike. I wanted to be like them.

    Learning to read music was an unwelcome chore, too, especially when my setlist consisted of nursery rhymes to be wrung out one note at a time. I wanted to learn guitar because an expert player sounded and looked cool, yet there wasn’t much that was cool about my tutor’s dry approach. So I quit lessons.

    Many of my favorite songs—from bands such as Tool, Led Zeppelin, Metallica and Rage Against The Machine—sounded thin and bloodless when ineptly fretted on an acoustic guitar. Eventually, my wallet lined with money saved from my first job as a dishwasher at a Sizzler restaurant, I acquired the desired technological upgrade: an electric guitar—a handsome, dark blue copy of the classic Fender Stratocaster—and a 30-watt amp.

    To read the full story, visit Backchannel.

    Note: I also published two outtakes from this story on Medium.com, which are essentially ‘deleted scenes’ from the longer story. The first is about Rocksmith’s origins, and the second is about the process through which Ubisoft licenses popular music to appear in Rocksmith.