Sections

Services

Information

UK United Kingdom

Learning a language and translating the web: does Duolingo work?

Duolingo, a new free language-learning site, says it can help you learn a language for free while simultaneously using your learning exercises to translate the web. A pretty big claim, but at the heart…

There’s plenty of excitement around Duolingo – a new idea to learn languages while translating the web. But does it work? Words image from www.shutterstock.com

Duolingo, a new free language-learning site, says it can help you learn a language for free while simultaneously using your learning exercises to translate the web.

A pretty big claim, but at the heart of Duolingo is an interesting idea – that people can use computers to do something while computers, in the background, achieve something else.

It’s much the same idea behind the founder of Duolingo, Luis von Ahn’s other venture – reCAPTCHA. This program uses the simple tests that prove you’re a human (and not an internet bot) to also help identify words scanned from old books.

An example of a reCAPTCHA form. reCAPTCHA/Wikimedia Commons

Released to the general public in June 2012, Duolingo already boasts over 300,000 active learners and has raised $US15 million of venture capital. But despite a great deal of attention, all the information we have on how it works is from one condensed TED talk. And as yet, no formal independent review of the program has been published.

Earlier this year, I took the program for a test-drive (as a reviewer, not as a genuine learner), to check whether what Duolingo offers matches von Ahn’s promises on language learning and translating.

The new lingo

Von Ahn claims that with Duolingo people can learn a language about as well as with the leading language learning software through translation.

For centuries, translation was the core of formal instruction for language learning but then, in the sixties, the communicative approach replaced it. Duolingo is basically bringing the translation model of language learning back.

Luis von Ahn on Ted.com

So does it work for language learning?

It does, surprisingly well. Translation gives the learner control over the process and a sense of achievement – translating words is often easier than dealing with lots of interaction, especially if you’re a beginner.

Duolingo also uses gamification to great effect and always gives immediate, automated feedback and points.

The program also allows learners to review and look at how other learners have translated text, which can help with understanding their own translations.

But the program also makes mistakes, and the more you advance, the more you notice them, which can be frustrating.

Is it as good as the leading language learning software as promised? It is good, but lacks many of the bells and whistles available in others: audiovisual context (BBC Languages), speech recognition and synthesis (Rosetta Stone), use of virtual words (Avatar English), native-to-learner interaction, not just peer-to-peer (Livemocha).

Lost in translation

The other half of the Duolingo project is translation.

For translating the web, machine translation is not good enough and relying only on professional translators is far too expensive. Duolingo offers a third way, with translation as a by-product of language learning – making it notionally almost as cheap as if done by machines and almost as good as if by professionals.

Once learners make some progress, they are asked to participate with real texts in real translation projects. It is by clients paying for these learner’s translations that Duolingo will make money.

It’s a clever idea but, does it work?

Below are two examples, one that featured in von Ahn’s Ted Talk and the second from my own own test-drive.

Firgue 1: Ted talk example. Ted.com

Figure 2: Author’s attempt. Author

The first indeed shows a translation equivalent to a professional. But my example shows a translation equivalent to one done by a machine.

My first attempt (in Figure 2) also got disappointing feedback, but when I entered it into the Google Translate version, it got “94% agreement with correct solutions from others”.

So what’s happening here? My guess is that the system gets machine translation as the reference on which to base its automatic feedback. Then they hope learners, by voting, will end up getting the final version right.

That’s what they did in the German example above (in Figure 1) – which must have had the professional version entered as a learner’s input.

If I’m right, this makes a professional quality translation uncertain, unless there was at least one professional quality version for each sentence in the database – and that’s unlikely.

The final verdict

Duolingo will only work for texts for which accurate and elegant translation is not critical, and only if it’s capable of retaining massive numbers of advanced learners. It needs to capture the “whole” language learning market and be recognised as the undisputed leader – the Facebook or Google of language learning.

But there is fierce competition out there and expectations are very high. Major tweaking in its feedback algorithms is still needed.

Technology-wise, taking the source from the web, translating it in Duolingo and inserting the target back in the web seems less complicated than what reCAPTCHA does with words - but language is not about words, it’s about meaning. And ultimately, this is where Duolingo falls short.

Sign in to Favourite

Join the conversation

3 Comments sorted by

  1. Chris Booker

    Research scientist

    okay so I speak Spanish - as a second language, but quite well, can read books, talk and write often in Spanish,etc. - and I can't figure out what the sentence in Figure 2 is trying to say exactly. Is it even correct Spanish? I think if you're input phrase isn't correct language usage then the whole thing comes undone. Especially so if the idea is to translate the internet, which is full of incorrect grammar, and particularly, regional differences in word usage and slang, etc.

    report
  2. Andrew S. Campbell

    logged in via LinkedIn

    Your article seemed to make sense to me and it appeared you had raised a valid point about DuoLingo however then I read the comment from a user and realized that he's right, your Spanish input example is a disaster, where did you find it? Do you speak a 2nd language out of curiosity? If you're judging the comprehension of the machine learning system of DuoLingo on non-native, incomprehensible language examples like this one then it's not a fair test and the reasoning and hence the argument you've proposed is null and void. An example of why hands-on language learners need to be contributing to 'the conversation' surrounding language training and not just PHDs.

    report
    1. Andrew S. Campbell

      logged in via LinkedIn

      In reply to Andrew S. Campbell

      This article does make several good points but the spanish example to me just makes no sense so I would have liked to see what an example using a better example would have looked like. Thank you. This is only one of two truly objective articles I found on this subject.

      report