Visualizing the Afghan meltdown

The following article is from Wired:

It’s one thing to read about individual Taliban attacks in WikiLeaks’ trove of war logs. It’s something quite different to see the bombings and the shootings mount, and watch the insurgency metastasize.

NYU political science grad student (and occasional Danger Room contributor) Drew Conway has done just that, using an open source statistical programming language called R and a graphical plotting software tool. The results are unnerving, like stop-motion photography of a freeway wreck. Above is the latest example: a graph showing the spread of combat from 2004 to 2009. It’s exactly what you wouldn’t want to see as a war drags on.

“The sheer volume of observations [in the WikiLeaks database] inhibit the majority of consumers from being able to gain knowledge from it. By providing graphical summaries of the data people can draw inferences quickly, which would have been very difficult to do by serially reading through the files,” Conway e-mails Danger Room. “For instance, in the most recent graph I posted [see above], many people were noticing the increasing number of attacks around Afghanistan’s ‘ring road,’ over time, and seeing that as an indication of the Taliban’s attempt to undermine the Afghanistan government by cutting off villages from one another.”

Conway’s work largely mirrors what the U.S. military’s internal teams of intelligence analysts found. But Conway and Columbia University post-doc Mike Dewar did all this work themselves, relying solely on free tools and the WikiLeaked logs. Applying statistical analysis, they found little evidence of tampering in the reports. Next month, Conway hopes, a group of New York-based R users will be able to tease out more insights from the data.

Obviously, the logs don’t tell the whole story of the war, as Danger Room has noted before. And the stats may be unduly influenced by the spread of NATO forces into different parts of the country. But for now, the most striking point to Conway was how bad things turned in 2006 and 2007. In Afghanistan’s south, for instance, there was only minimal fighting in the start of ‘06. By the end of the next year… well, see for yourself.


UPDATE: Conway’s work is just one of dozens of international efforts to turn the WikiLeaks war logs into something graphic. Visualising Data has links to some of the best, including this one:

flynn_slide_1

The Taliban not only has the “momentum” after the most successful year in its campaign against the United States and the Kabul government. “The Afghan insurgency can sustain itself indefinitely,” according to a briefing from Major General Michael Flynn, the top U.S. intelligence officer in the country. “The Taliban retains [the] required partnerships to sustain support, fuel legitimacy and bolster capacity.”

And if that isn’t enough, Flynn also warns that “time is running out” for the American-led International Security Assistance Force. “Regional instability is rapidly increasing and getting worse,” the report says.

Since General Stanley McChrystal took over as top commander in Afghanistan, there have been a series of dark appraisals about the state of the war. In August, McChrystal warned of an “urgent need for a significant change to our strategy and the way that we think and operate.” A report recently obtained by NBC News said Afghanistan’s security forces won’t be ready to fight the Taliban for years — if ever. Earlier this week, Flynn issued a white paper complaining that “eight years into the war in Afghanistan, the U.S. intelligence community is only marginally relevant to the overall strategy.”

But Flynn’s December 23rd presentation on the “State of the Insurgency: Trends, Intentions and Objectives” may be the gloomiest public assessment of the war yet. The “loosely organized” Taliban is “growing more cohesive” and “increasingly effective.” The insurgents now have their own “governors” installed in 33 of Afghanistan’s 34 provinces. And the “strength and ability of [that] shadow governance increasing,” according to the presentation. The Taliban’s “organizational capabilities and operational reach are qualitatively and geographically expanding.”

Improvised bomb “events” have nearly tripled since 2007 — 7228 this year, compared to 2718 two years ago. The bombs have grown bigger — the majority are now 25 pounds or more. “80 to 90 percent” of them are made with homemade fertilizer, rather than military ordnance. That makes it much harder to track and block the distribution of the bomb-making material. Add to that steady supply of cash, thanks to the drug trade and the corrupt Kabul government, and a glut of weapons and ammunition,” and it becomes clear why, in Flynn’s words, “the insurgency is confident…  looking toward post-ISAF Afghanistan.”

The presentation also cast doubt on some of the war’s stated central aims. The Obama administration has repeatedly said that additional troops are necessary to prevent a Taliban takeover of Afghanistan — which would then allow Al Qaeda the re-establigh its safe haven there. According to interviews with detainees, however, the insurgents “view Al Qaeda as a handicap – a view that is increasingly prevalent.” The Taliban feel they have to “manage [the] relationship with AQ to avoid alienating Afghan population, but encourage support from [the] global jihad network.”

Flynn’s presentation also, indirectly, warns that one of the central U.S. tactics in Pakistan — drone strikes against suspected militants — could backfire. “violations of Pakistan sovereignty may contribute to radicalizing the population and diminishes credibility of the GoP [Government of Pakistan].” Such violations “demonstrat[e] an inability of the government; perception they cannot protect their own; exacerbates anti-western sentiment.”

Within military circles, there’s a sense that Flynn may be underplaying recent American successes in Helmand province and elsewhere. And Flynn does note that there’s still hope for the American effort in the region. “We have a key advantage – [the] Taliban is not a popular movement (yet),” the report says. What’s more, there are “persistent fissures among insurgent leadership at local levels” and an “over-reliance on external support.”

Exploiting those fissures — and beating the Taliban — will “requir[e] operating / thinking in a fundamentally new way.”

Cognitive surplus: creativity and generosity in a connected age

Just in the United States, Clay Shirky maintains, we collectively watch about 200 billion hours of TV every year. For a vast majority of us, watching TV is essentially a part-time job.

What would the world be like if many of us quit our TV-watching gigs? Critics of television have long lamented its opportunity costs, but Shirky’s inquiry into what we might join together to do instead if we weren’t watching TV isn’t as fantastical as previous efforts. That’s because for the first time since the advent of television, something strange is happening — we’re turning it off. Young people are increasingly substituting computers, mobile phones and other Internet-­enabled devices for TV.

The time we might free up by ditching TV is Shirky’s “cognitive surplus” — an ocean of hours that society could contribute to endeavors far more useful and fun than television. With the help of a researcher at I.B.M., Shirky calculated the total amount of time that people have spent creating one such project, Wikipedia. The collectively edited online encyclopedia is the product of about 100 million hours of human thought, Shirky found. In other words, in the time we spend watching TV, we could create 2,000 Wikipedia-size projects — and that’s just in America, and in just one year.

Save the children

"Turn off the internet, the CD-ROMS, and the computer games and let your children stare at a tree for a couple of hours. Every now and then they'd actually come up with one of their own ideas..."

I know that all you boring single dads and working moms, who think you're such fucking heros, aren't gonna like this, but somebody's gotta tell you for your own good: your children are overrated and overvalued, and you've turned them into little cult objects. You have a child fetish, and it's not healthy.
And don't give me all that weak shit, "Well, I love my children." Everybody loves their children; it doesn't make you special. And that's not what I'm talking about. What I'm talking about is this constant, mindless yammering in the media, this neurotic fixation that suggests that somehow everything--everything--has to revolve around the lives of children. It's completely out of balance.

Listen, there are a couple of things about kids you have to remember. First of all, they're not all cute. In fact, if you look at 'em real close, most of them are rather unpleasant looking. And a lot of them don't smell too good either. The little ones in particular seem to have a kind of urine and sour-milk combination that I don't care for at all. Stay with me on this folks, the sooner you face it the better off your going to be.

Second, premise: not all chidren are smart and clever. Got that? Kids are like any other group of people: a few winners, a whole lot of losers! This country is filled with loser kids who simply...aren't...going anywhere! And there's nothing you can do about it, folks. Nothing! You can't save them all. You can't do it. You gotta let 'em go; you gotta cut 'em loose; you gotta stop over-protecting them, because your making 'em too soft.

Today's kids are way too soft.
For one thing, there's too much emphasis on safety and safety equipment: childproof medicine bottles, fireproof pajamas, child restraints, car seats. And helmets! Bicycle, baseball, skateboard, scooter helmets. Kids have to wear helmets now for everything but jerking off. Grown-ups have taken all the fun out of being a kid.
What's happened is, these baby boomers, these soft, fruity baby boomers, have raised an entire generation of soft, fruity kids who aren't even allowed hazardous toys, for Chrissakes! What ever happened to natural selection? Survival of the fittest? The kid who swallows too many marbles doesn't grow up to have kids of his own. Simple stuff. Nature knows best!

And one more item about children: this superstitous nonsense of blaming tobacco companies for kids who smoke. Listen! Kids don't smoke because a camel in sunglasses tells them to. They smoke for the same reasons adults do, because it's an enjoyable activity that relieves anxiety and depression.

And you'd be anxious and depressed too if you had to put up with these pathetic, insecure, yuppie parents who enroll you in college before you've figured out which side of the playpen smells the worst and then fill you with Ritalin to get you in a mood they approve of, and drag you all over town in search of empty, meaningless structure: Little League, Cub Scouts, swimming, soccer, karate, piano, bagpipes, watercolors, witchcraft, glass blowing, and dildo practice. It's absurd. They even have "play dates", for Christ sake! Playing is now done by appointment!
But it's true. A lot of these striving, and parents are burning their kids out on structure. I think what every child needs and ought to have every day is two hours of daydreaming. Plain old daydreaming.

Turn off the internet, the CD-ROMS, and the computer games and let them stare at a tree for a couple of hours. Every now and then they actually come up with one of their own ideas.
You want to know how to help your kids? Leave them the fuck alone.
-- George Carlin

Steve Howe guitar solo (clip)

Current members of Asia are the following founding members:

Exercise boosts your brain

New research is showing some of the molecular reasons why keeping fit also keeps you sharp, and it has to do with your brain’s untapped potential for growth.

Dr. Fred Gage and collaborators have been publishing a variety of papers describing the molecular pathways by which exercise leads to brain growth. Gage’s work in the 90’s showed that our brains have a store of stem cells that lie largely dormant, waiting for some stimulus to initiate cell division. A growth factor called bone morphogenetic protein (BMP) works to control cell division throughout the body, including in the brain. The more BMP, the less growth. Regulatory factors like BMP are essential to a healthy body; studies have shown that the absence of BMP activity is linked to colon cancer.

But as we get older, higher counts of BMP accumulate in the brain and keep our neural stem cells asleep. This is where exercise comes in. Within one week of being given an exercise wheel, mice showed half as much BMP signaling in their brains. The mice also showed increased levels of the protein Noggin (yes, I know), which acts as a BMP-antagonist. There are still questions as to whether exercise directly decreases BMP, or does so indirectly via Noggin production. Either way, stem cells begin to divide and new neurons are born.

This new form of entertainment has gone far to blast maidenhood

Children support the picture shows at a cost to their little souls and bodies and minds that no one can compute... This new form of entertainment has gone far to blast maidenhood and has led many boys to criminal careers... 

There is a new form of degeneracy born of these shows.  Boys and girls are together in the room darkened while the pictures are on, and, as the entire show lasts usually an hour and a half, indecent assaults upon the girls follow, often with their acquiescence...

The Society has prosecuted many for leading girls astray through these picture shows, but God alone knows how many are leading dissolute lives begun at the "moving pictures."

Documents of the Senate of the State of New York, Volume 5, 1909

So that's 2,441 down, 129,862,439 to go ...

When you are part of a company that is trying to digitize all the books in the world, the first question you often get is: “Just how many books are out there?”

Well, it all depends on what exactly you mean by a “book.” We’re not going to count what library scientists call “works,” those elusive "distinct intellectual or artistic creations.” It makes sense to consider all editions of “Hamlet” separately, as we would like to distinguish between -- and scan -- books containing, for example, different forewords and commentaries.

One definition of a book we find helpful inside Google when handling book metadata is a “tome,” an idealized bound volume. A tome can have millions of copies (e.g. a particular edition of “Angels and Demons” by Dan Brown) or can exist in just one or two copies (such as an obscure master’s thesis languishing in a university library). This is a convenient definition to work with, but it has drawbacks. For example, we count hardcover and paperback books produced from the same text twice, but treat several pamphlets bound together by a library as asean single book...

So after all is said and done, how many clusters does our algorithm come up with? The answer changes every time the computation is performed, as we accumulate more data and fine-tune the algorithm. The current number is around 210 million.

Is that a final number of books in the world? Not quite. We still have to exclude non-books such as microforms (8 million), audio recordings (4.5 million), videos (2 million), maps (another 2 million), t-shirts with ISBNs (about one thousand), turkey probes (1, added to a library catalog as an April Fools joke), and other items for which we receive catalog entries.

Counting only things that are printed and bound, we arrive at about 146 million. This is our best answer today. It will change as we get more data and become more adept at interpreting what we already have...

After we exclude serials, we can finally count all the books in the world. There are 129,864,880 of them.