Many people outside the Muslim world follow the news through social media. It helps if you can speak a local language. As NPR's Christopher Joyce reports, American scientists are trying to get computers to work around that problem.

CHRISTOPHER JOYCE: There are computer programs to translate text from one language to another. Languages like Arabic or Urdu are tough, though. The script and the grammar are hugely different from European languages, and digitized dictionaries and grammatical algorithms for those languages are still in the early stages.

But these languages are politically important. Urdu, for example, is the language of Pakistan and of many Muslims in India. It's a mix of Hindi and Persian, and uses Arabic script.

Computer scientist Rohini Srihari says existing computer translators for Urdu are often too literal.

Ms. ROHINI SRIHARI (Computer Scientist, Janya, Inc.): What I want is to determine who are the people, places and things being talked about. Is there an opinion being expressed? Is it a positive or negative opinion being expressed?

JOYCE: At the University of Buffalo, Srihari has developed a natural language program that she says can do that. The computer has learned the nuances of written Urdu. Some of this is fairly mechanical. Urdu doesn't have the same kind of clear breaks between one word and the next the way English does. Some things are subtle, as in characters and words whose placement may connote sentiment.

Ms. SRIHARI: And when you're able to figure out what the topic of the conversation is, what kind of sentiment is being expressed around that, that's the goal of what we're trying to do.

JOYCE: On the screen, Srihari says, you can mouse over a section of script, and if it carries a negative connotation, it will highlight red. If it has a positive sentiment, it glows green. Srihari says the computer allows her to mine the Internet. Her research company gets funding from the Pentagon for the project.

Ms. SRIHARI: So in Twitter posts and tweets and so on, if there's specific factual information that's being mentioned, they want that extracted. There's also definitely an interest in sentiment and opinion mining.

JOYCE: Social media and the opinions that get slung around digitally around the world's hot spots are also of interest to political scientists and historians.

Ernest Tucker is a history professor with the Center for Middle East and Islamic Studies at the U.S. Naval Academy. He struggles with Urdu himself.

Professor ERNEST TUCKER (Center for Middle East and Islamic Studies, U.S. Naval Academy): (Urdu spoken)

(Soundbite of laughter)

Prof. TUCKER: That's saying my Urdu's not very good in Urdu.

JOYCE: But Tucker does speak and read Persian, which is close, and he regularly reads publications from the whole region. He argues that history is best told not by what the Napoleons say, but by the foot-soldiers or, in this case, the tweeters.

Prof. TUCKER: And that's the goal of all historians anywhere, is to try to get the voices of more and more and more people into the conversation. And anything that can do that, particularly this kind of thing, is to me, it's a wonderful gift.

JOYCE: Tucker says he's skeptical about how well a computer is going to identify sentiment. He says you'll still need a human linguist to fine-tune any translation. For example, he says it's common in Middle Eastern languages to employ couplets from traditional poetry to convey feelings - symbolic language that could confuse a computer program.

Prof. TUCKER: For the Iranians, for the Pakistanis, for the Indians, it's still a part of the living connection to the cultures of the past.

JOYCE: Rohini Srihari acknowledges the program isn't perfect. It gets flummoxed by things like Urdish, a mash-up language for text messaging that's part Urdu and part English. But it has given her insight into what Urdu speakers have been talking about lately.

Ms. SRIHARI: A lot of the conversation, believe it or not, was about cricket. That seems to be on everyone's mind, all the time.

JOYCE: Last week would have been a good time to tune into Urdu cyberspace. Pakistan played India in the world cricket semi-finals. Pakistan lost. No doubt, the Web traffic was full of strong sentiments.

Christopher Joyce, NPR News.

(Soundbite of music)

MONTAGNE: You're listening to MORNING EDITION, from NPR News.

Copyright © 2011 NPR. All rights reserved. Visit our website terms of use and permissions pages at for further information.

NPR transcripts are created on a rush deadline by a contractor for NPR, and accuracy and availability may vary. This text may not be in its final form and may be updated or revised in the future. Please be aware that the authoritative record of NPR’s programming is the audio.



Please keep your community civil. All comments must follow the Community rules and terms of use, and will be moderated prior to posting. NPR reserves the right to use the comments we receive, in whole or in part, and to use the commenter's name and location, in any medium. See also the Terms of Use, Privacy Policy and Community FAQ.