Focal Visual-Text Attention for Memex Question Answering
Junwei Liang1, Lu Jiang2, Liangliang Cao3, Yannis Kalantidis4, Li-Jia Li2, Alexander Hauptmann1
1Carnegie Mellon University, 2Google AI, 3University of Massachusetts, 4Facebook Research
In IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI).
Explore MemexQA dataset
     
Showing 5 albums of the same Flickr user.
Title: Mother's Day 2005
Description: My mom wanted to go hiking at Letchworth Park for Mother's Day, so that's what we did. ...
When: on May 08 2005
Where: None
1. Dam it Dad
2. Dad and Mom
3. Waterfall
4. I HEAR ME SOME INJUNS
5. Train parts
6. Tas and Eric
7. The train trestle
8. Another train came as we were leaving
Title: End-of-the-year Party
Description: The day before we got off probation (we didn't think that part through) ...
When: on May 20 2005
Where: New York, 14623, USA
1. Guys
2. They're funner than they look
3. Indie kids don't smile
4. AWWWWW
5. Couch
6. Sing it brotha
7. DRINK IT
8. Indie kids don't smile
9. Shake it
10. What the hell is he doing?
Title: Champagne Party Episode III: Revenge of the Swank
Description: The third annual swanky summertime campagne party ...
When: on June 11 2005
Where: New York, 14623, USA
1. People
2. Tape me up!
3. Ello?
4. Marcin
5. Aren't we precious
6. Tape me up
7. Tape me up
8. Edward Champagne Hands
9. Couch
10. WHO'S THAT SEXY DEVIL
Title: Redneck Party
Description: We finally got around to hosting the redneck party. ...
When: on August 06 2005
Where: New York, 14623, USA
1. Pre-party
2. Real men drink beer from cans
3. Sideburns
4. Singing
5. Singing something
6. Pre-party
7. James and Whiskey
8. Eric, Tas and John
9. More dancing
10. Sharon
Title: FUMN, Jan 2006
Description: Schmitty, Casey and I drove up to Rochester for the weekend ...
When: on January 20 2006
Where: New York, 14623, USA
1. The left my goodbye banner up
2. Casey and Grahams
3. Schmitty Hendrix
4. Girard
5. A terible picture of Fonny and Molly
6. Casey and Schmitty, on the road
7. Jared really is that engaging
8. Schmitty spotting Girard
Question No. 1 / 9
What did we celebrate in May 2007?
(1) Mother's day ✔ Correct Answer
(2) Their third wedding anniversary
(3) Birthday
(4) Christmas
Question No. 2 / 9
When did we last have some champagne?
(1) June 11 2005 ✔ Correct Answer
(2) May 20 2005
(3) January 20 2006
(4) May 8 2005
Question No. 3 / 9
When was the last time I saw a vehicle?
(1) May 8 2005
(2) January 20 2006 ✔ Correct Answer
(3) June 11 2005
(4) May 20 2005
Question No. 4 / 9
Where did we go to a country themed event?
(1) New York ✔ Correct Answer
(2) California
(3) Downtown
(4) Washington
Question No. 5 / 9
What color was the couch in May 2005?
(1) Gray ✔ Correct Answer
(2) Yellow
(3) Red
(4) Black
Question No. 6 / 9
What did we do the day before we got off probation?
(1) Throw an end of the year party ✔ Correct Answer
(2) Sightseeing
(3) Swimming
(4) Go hiking
Question No. 7 / 9
What did people dress up as in August 2005?
(1) Cats
(2) Rednecks ✔ Correct Answer
(3) Pandas
(4) Superman
Question No. 8 / 9
When was the last time we saw a dam?
(1) May 8 2005 ✔ Correct Answer
(2) May 20 2005
(3) June 11 2005
(4) January 20 2006
Question No. 9 / 9
How many hands were taped to the bottles in June 2005?
(1) 286
(2) 2 ✔ Correct Answer
(3) 11
(4) 10