Democratic Underground Latest Greatest Lobby Journals Search Options Help Login
Google

The Guardian: Embassy Cables - Google Fusion Table Storyline Of Cables Sent In The Weeks Around 9/11

Printer-friendly format Printer-friendly format
Printer-friendly format Email this thread to a friend
Printer-friendly format Bookmark this thread
This topic is archived.
Home » Discuss » Archives » General Discussion (1/22-2007 thru 12/14/2010) Donate to DU
 
Turborama Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Nov-28-10 05:01 PM
Original message
The Guardian: Embassy Cables - Google Fusion Table Storyline Of Cables Sent In The Weeks Around 9/11
Edited on Sun Nov-28-10 05:36 PM by Turborama
The WikiLeaks embassy cables release has produced a lot of stories but does it produce any useful data? We explain what it includes and how it breaks down - plus you can download the key data for every cable


WikiLeaks cables broken down. Click image for full graphic.
Illustration: Finbarr Sheehy for the Guardian

Google fusion table storyline of cables sent in the weeks around 9/11 - click on a cable to find out the tags. Get the fullscreen version here or click here to download the data

We've broken down the data for you - and you can download the basic details of every cable (without the actual content) below. Each cable is essentially very structured data. This is what's included:

A source, ie the embassy or body which sent it
There is a list of recipients - normally cables were sent to a number of other embassies and bodies
There is a subject field - basically a summary of the cable
Tags - each cable was tagged with a number of keyword abbreviations. We've put together a downloadable Google glossary spreadsheet of most of the important ones here
Body text - the cable itself. We have opted not to publish these in full for obvious security reasons

Thanks to Guardian developer Daithi Crualaoich we've performed some analysis of the data - which you can download for yourself below. The key points are:

251,287 dispatches
The state department sent the most cables in this set, followed by Ankara in Turkey, then Baghdad and Tokyo
97,070 of the documents were classified as 'Confidential'
28,760 of them were given the tag 'PTER' which stands for prevention of terrorism
The earliest of the cables is from 1966 - with most, 56,813, from 2009

21:35pm, 28.11.2010: We've just added a CSV download - see below. Remember this is the date, time, sender and tags for each cable - NOT the text of the cable itself

WikiLeaks embassy cables revelations cover a huge dataset of official documents: 251,287 dispatches, from more than 250 worldwide US embassies and consulates. It's a unique picture of US diplomatic language - including over 50,000 documents covering the current Obama administration. But what does the data include?

The cables themselves come via the huge Secret Internet Protocol Router Network, or SIPRNet. SIPRNet is the worldwide US military internet system, kept separate from the ordinary civilian internet and run by the Department of Defense in Washington. Since the attacks of September 2001, there has been a move in the US to link up archives of government information, in the hope that key intelligence no longer gets trapped in information silos or "stovepipes". An increasing number of US embassies have become linked to SIPRNet over the past decade, so that military and diplomatic information can be shared. By 2002, 125 embassies were on SIPRNet: by 2005, the number had risen to 180, and by now the vast majority of US missions worldwide are linked to the system - which is why the bulk of these cables are from 2008 and 2009.

An embassy dispatch marked SIPDIS is automatically downloaded on to its embassy classified website. From there, it can be accessed not only by anyone in the state department, but also by anyone in the US military who has a security clearance up to the 'Secret' level, a password, and a computer connected to SIPRNet - which astonishingly covers over 3m people. There are several layers of data in here - ranging up to the "SECRET NOFORN" level, which means that they are designed never be shown to non-US citizens. Instead, they are supposed to be read by officials in Washington up to the level of current Secretary of State Hillary Clinton. The cables are normally drafted by the local ambassador or subordinates. The "Top Secret" and above foreign intelligence documents cannot be accessed from SIPRNet.

Download the data

DATA: every cable with date, time and tags, EXCLUDING BODY TEXT (via Google fusion tables, subject to heavy traffic)
DATA: every cable with date, time and tags, EXCLUDING BODY TEXT (CSV file, 16MB)
DATA: our analysis of the cable by location and tag
DATA: glossary of keywords and tags

More: http://www.guardian.co.uk/news/datablog/2010/nov/29/wik...
Printer Friendly | Permalink |  | Top
Turborama Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Nov-28-10 05:21 PM
Response to Original message
1. Larger graphic
Edited on Sun Nov-28-10 05:21 PM by Turborama
Printer Friendly | Permalink |  | Top
 
Old and In the Way Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Nov-28-10 06:21 PM
Response to Reply #1
4. None from Saudi Arabia?
Seems strange.
Printer Friendly | Permalink |  | Top
 
de novo Donating Member (590 posts) Send PM | Profile | Ignore Sun Nov-28-10 08:43 PM
Response to Reply #4
11. That is strange. They must have a highly confidential direct protected line.
Printer Friendly | Permalink |  | Top
 
jberryhill Donating Member (1000+ posts) Send PM | Profile | Ignore Mon Nov-29-10 06:16 AM
Response to Reply #11
14. Or we are only being shown what someone wants us to see
Printer Friendly | Permalink |  | Top
 
Turborama Donating Member (1000+ posts) Send PM | Profile | Ignore Mon Nov-29-10 12:19 AM
Response to Reply #4
12. There are some but not in the selection for that graphic, for some reason
In the top left hand corner they say it's a selection of cables.

Their interactive graphic has links to some...

http://www.guardian.co.uk/world/interactive/2010/nov/28...
Printer Friendly | Permalink |  | Top
 
Turborama Donating Member (1000+ posts) Send PM | Profile | Ignore Mon Nov-29-10 06:09 AM
Response to Reply #4
13. In fact, looking at CableGate's site there have been no cables from 2000 released yet
Probably going to come out in a whole batch of their own within the next few months: http://www.democraticunderground.com/discuss/duboard.ph...
Printer Friendly | Permalink |  | Top
 
Joanne98 Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Nov-28-10 06:02 PM
Response to Original message
2. That's really cool!
Printer Friendly | Permalink |  | Top
 
Catherina Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Nov-28-10 06:03 PM
Response to Original message
3. Bookmarked and rec'd n/t
Printer Friendly | Permalink |  | Top
 
jannyk Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Nov-28-10 06:22 PM
Response to Original message
5. Wow - thanks! k&r
Printer Friendly | Permalink |  | Top
 
Poboy Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Nov-28-10 06:24 PM
Response to Original message
6. recommend.
Printer Friendly | Permalink |  | Top
 
crikkett Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Nov-28-10 07:02 PM
Response to Original message
7. It's nothing without the body text don't you think?
Does anyone know if wikileaks will publish the full data?

Printer Friendly | Permalink |  | Top
 
crikkett Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Nov-28-10 08:41 PM
Response to Reply #7
10. Full data is published at wikileaks.org
Printer Friendly | Permalink |  | Top
 
SpiralHawk Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Nov-28-10 07:45 PM
Response to Original message
8. So does this mean AWOL Bush and Five Deferments Cheney & RepubliCronies ignored...
even more more more warnings about 9/11?

I am aware that they ignored over 60 warning beforehand. Does this mean they ignored even more?

Jeez, Republicon chickenhakws. Such frikking sad cases.
Printer Friendly | Permalink |  | Top
 
Canuckistanian Donating Member (1000+ posts) Send PM | Profile | Ignore Sun Nov-28-10 07:56 PM
Response to Original message
9. Strange. Lots of cables from Tokyo, Taiwan and Sri Lanka
3 countries I wouldn't have guessed had much to do with the "war on terror".
Printer Friendly | Permalink |  | Top
 
DU AdBot (1000+ posts) Click to send private message to this author Click to view 
this author's profile Click to add 
this author to your buddy list Click to add 
this author to your Ignore list Wed Apr 16th 2014, 09:21 PM
Response to Original message
Advertisements [?]
 Top

Home » Discuss » Archives » General Discussion (1/22-2007 thru 12/14/2010) Donate to DU

Powered by DCForum+ Version 1.1 Copyright 1997-2002 DCScripts.com
Software has been extensively modified by the DU administrators


Important Notices: By participating on this discussion board, visitors agree to abide by the rules outlined on our Rules page. Messages posted on the Democratic Underground Discussion Forums are the opinions of the individuals who post them, and do not necessarily represent the opinions of Democratic Underground, LLC.

Home  |  Discussion Forums  |  Journals |  Store  |  Donate

About DU  |  Contact Us  |  Privacy Policy

Got a message for Democratic Underground? Click here to send us a message.

© 2001 - 2011 Democratic Underground, LLC