toy data + default model dir

tensorflow/nlp/data/small/dev/labels.txt

@@ -1,10 +1,10 @@
-B-per I-per O O O B-tim O O B-tim O O O B-geo O O O O O O O O O O
-O O O O B-gpe B-per I-per I-per O O B-org I-org I-org I-org I-org O O O O O O O O B-geo O O O O O O O O O
-O B-org I-org I-org O O O O O O O O
-B-gpe O O O O O O O B-gpe O O O O O O O O O O O O O O O O B-geo O
-O O O B-org I-org O O O O O B-geo O O O O B-org O O O O B-gpe O O O O O
-O O O B-per I-per I-per O O B-tim O B-gpe O O O O O O O B-gpe O O B-geo O O O O O O O O B-geo O
-B-org O O O O O O O O O O O O O O O O O O O O O O
-O B-tim O B-gpe O O O O O O O O O O O O O O O O O O B-org O O O
-O B-gpe O O O O O O O O O O O O O O O O O O B-org O B-org O
-B-geo O O O O O O O O O O O O O O O O O O O O O O O
+B-PER O O B-LOC I-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC

tensorflow/nlp/data/small/dev/sentences.txt

@@ -1,10 +1,10 @@
-Mr. Nour was arrested in January and spent six weeks in a Cairo jail , before his release on bond last week .
-In a letter to Egyptian President Hosni Mubarak , the New York-based Human Rights Watch said it was dismayed by what it called Cairo 's " radical intolerance " toward political dissent .
-The U.S. State Department and the European parliament also voiced concern .
-Pakistani military officials say 14 of about 40 Pakistani soldiers who went missing following an attack on a security checkpoint have been found in neighboring Afghanistan .
-Officials say the Frontier Corps paramilitary troops disappeared from the Mohmand tribal region after a Taliban insurgent attack along the Afghan border earlier this week .
-Military spokesman Major General Athar Abbas told reporters Thursday that Afghan authorities handed over the troops to the Pakistani consulate in Jalalabad and the soldiers were being flown back to Pakistan .
-Taliban militants said they captured 10 soldiers during the attack on the paramilitary post , but officials could not verify the claim .
-On Wednesday , Pakistani officials said 10 paramilitary soldiers and at least 36 militants were killed in fighting in the country 's Bajaur tribal region .
-The Pakistani military has twice declared victory there following offensives aimed at clearing the area of insurgents linked to the Taliban and al-Qaida .
-Thailand 's military has named a committee to begin the process of writing a new constitution , following a military coup last month .
+John lives in New York
+Kate lives in London
+Ziang lives in Beijing
+Pierre lives in Paris
+Dominik lives in Berlin
+Raul lives in Mexico
+Sergio lives in Rome
+Alexandr lives in Moscow
+Ines lives in Casablanca
+Jack lives in San Francisco

tensorflow/nlp/data/small/test/labels.txt

@@ -1,10 +1,10 @@
-O O B-org I-org I-org I-org O B-geo O B-gpe B-per I-per I-per I-per O O O O O O B-geo O O
-O O O O O O O O O
-O O O O O B-geo O O O B-tim O O O O O O O
-O O O O O O O O O O O O O B-geo O O O O O O O O O O
-O B-org I-org I-org I-org I-org O O O O B-org I-org I-org I-org I-org O O O O O O O O O O B-geo O
-O O O O O O O O O O B-geo O O B-org I-org I-org I-org O
-O O O O B-org O O O O O O O O O B-geo O O O O
-O O O O B-geo O O O O O O O O O O O O O O O O O O O B-geo O
-B-gpe O O O O O O O O O O O O O O B-gpe O O B-per I-per O
-O O O O O O B-tim O O O O O O O O O O B-geo O
+B-PER O O B-LOC I-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC

tensorflow/nlp/data/small/test/sentences.txt

@@ -1,10 +1,10 @@
-At the Group of Eight summit in Scotland , Japanese Prime Minister Junichiro Koizumi said he is outraged by the London attacks .
-He noted terrorist acts must not be forgivable .
-Sarin gas attacks on the Tokyo subway system in 1995 killed 12 people and injured thousands .
-A human rights group has called on Asian leaders to increase pressure on Burma to hasten democratic reforms and stop human rights abuses .
-The Alternative ASEAN Network for Burma said officials from the Association of Southeast Asian Nations meeting this week should consider new options in dealing with Burma .
-It said leaders should consider supporting a possible resolution on Burma by the United Nations Security Council .
-The group also urged ASEAN leaders to acknowledge the many security problems caused by Burma 's military regime .
-The rights group accuses Burma 's government of involvement in illegal drug trafficking and human rights abuses , especially against some ethnic groups in Burma .
-Iraqi officials say gunmen have killed a member of the secular coalition led by former Iraqi prime minister Ayad Allawi .
-Officials say Faras al-Jabouri was shot Saturday after gunmen raided his home near the northern city of Mosul .
+John lives in New York
+Kate lives in London
+Ziang lives in Beijing
+Pierre lives in Paris
+Dominik lives in Berlin
+Raul lives in Mexico
+Sergio lives in Rome
+Alexandr lives in Moscow
+Ines lives in Casablanca
+Jack lives in San Francisco

tensorflow/nlp/data/small/train/labels.txt

@@ -1,10 +1,10 @@
-O O O O O O B-geo O O O O O B-geo O O O O O B-gpe O O O O O
-O O O O O O O O O O O O O O O O O O B-per O O O O O O O O O O O
-O O O O O O O O O O O B-geo I-geo O
-O O O O O O O O O O O O O O O
-O O O O O O O O O O O B-geo O O B-org I-org O O O B-gpe O O O B-geo O
-O O O O O B-gpe O O O O B-geo O O O O O O O B-gpe O O O O O
-O B-geo O O O O O O O O O O O O B-geo O B-geo O O B-geo O
-O B-org I-org I-org I-org O O O O O O O O B-geo B-tim O O O O O B-gpe O O O O O O O
-B-gpe O O O O O O O O O O B-geo O O O
-B-gpe O O O O O O O O O O O O O O B-tim O O O B-org O O O O O
+B-PER O O B-LOC I-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC
+B-PER O O B-LOC

tensorflow/nlp/data/small/train/sentences.txt

@@ -1,10 +1,10 @@
-Thousands of demonstrators have marched through London to protest the war in Iraq and demand the withdrawal of British troops from that country .
-Families of soldiers killed in the conflict joined the protesters who carried banners with such slogans as " Bush Number One Terrorist " and " Stop the Bombings . "
-They marched from the Houses of Parliament to a rally in Hyde Park .
-Police put the number of marchers at 10,000 while organizers claimed it was 1,00,000 .
-The protest comes on the eve of the annual conference of Britain 's ruling Labor Party in the southern English seaside resort of Brighton .
-The party is divided over Britain 's participation in the Iraq conflict and the continued deployment of 8,500 British troops in that country .
-The London march came ahead of anti-war protests today in other cities , including Rome , Paris , and Madrid .
-The International Atomic Energy Agency is to hold second day of talks in Vienna Wednesday on how to respond to Iran 's resumption of low-level uranium conversion .
-Iran this week restarted parts of the conversion process at its Isfahan nuclear plant .
-Iranian officials say they expect to get access to sealed sensitive parts of the plant Wednesday , after an IAEA surveillance system begins functioning .
+John lives in New York
+Kate lives in London
+Ziang lives in Beijing
+Pierre lives in Paris
+Dominik lives in Berlin
+Raul lives in Mexico
+Sergio lives in Rome
+Alexandr lives in Moscow
+Ines lives in Casablanca
+Jack lives in San Francisco

tensorflow/nlp/evaluate.py

@@ -16,7 +16,7 @@
 
 
 parser = argparse.ArgumentParser()
-parser.add_argument('--model_dir', default='experiments/test',
+parser.add_argument('--model_dir', default='experiments/base_model',
                     help="Directory containing params.json")
 parser.add_argument('--data_dir', default='data/small', help="Directory containing the dataset")
 parser.add_argument('--restore_from', default='best_weights',

tensorflow/nlp/train.py

@@ -15,7 +15,7 @@
 
 
 parser = argparse.ArgumentParser()
-parser.add_argument('--model_dir', default='experiments/test',
+parser.add_argument('--model_dir', default='experiments/base_model',
                     help="Directory containing params.json")
 parser.add_argument('--data_dir', default='data/small', help="Directory containing the dataset")
 parser.add_argument('--restore_dir', default=None,