", "Indian Space Research Organisation, India's national space agency, maintains an active space program. It operates a small commercial launch service and launched a successful unmanned lunar mission dubbed Chandrayaan-1 in October 2007. India has plans for a further unmanned mission to the Moon Chandrayaan 2 by end of 2016 or early 2017. India has successfully launched an interplanetary mission, Mars Orbiter Mission, in 2013 which reached Mars in September 2014, hence becoming the first country in the world to do a Mars mission in its maiden attempt. The ISRO is currently developing a small shuttle system. Cosmonauts and astronauts from other nations have flown in space, beginning with the flight of Vladimir Remek, a Czech, on a Soviet spacecraft on March 2, 1978. , a total of 536 people from 38 countries have gone into space according to the FAI guideline. India, Taiwan and Japan are increasingly capable of competing in space research and activity. These nations, along with China, form the main players in the Asian space race. Iran announced plans to begin a manned space program in 2021.", "The Indian Space Research Organisation has carried out 97 spacecraft missions,69 launch missions and planned many missions including Chandrayaan-2, and Aditya (spacecraft). This is the list of all completed missions. India's first satellite Aryabhata was launched by the Soviet Union on 19 April 1975 from Kapustin Yar using a Kosmos-3M launch vehicle. (It was built by the ISRO) to gain experience in building and operating a satellite in space. India has launched 100 Indian satellites of many types as on 31 January 2018. Satellites have been launched from various vehicles, including those launched by Russian, European and American rockets, as well as those launched indigenously by India. The organisation responsible for India's satellite program is the Indian Space Research Organisation (ISRO). ISRO also launches satellites for foreign countries. As of August 2018, ISRO has launched 209 satellites for 28 foreign countries. In 2016, India launched an additional 25 satellites for 6 different countries. In January 2017, India launched 104 satellite of different countries, out of which 96 are of America, by single launch vehicle.", "As India's space chief from November 2009 to December 2014, Radhakrishnan led ISRO to achieve 37 space missions including several historic feats including Mars Orbiter Mission; flying Indian Cryogenic Engine on GSLV; the first experimental flight of the GSLV Mk III; a re-entry experiment of an un-manned crew module; and new space capabilities through IRNSS (1A, 1B, 1C) for navigation; GSAT-7 for strategic communication; and RISAT-1 for microwave radar imaging. ISRO completed two joint satellite missions (Megha Tropiques and SARAL) with the French National Space Agency and inked another agreement with NASA to jointly build an advanced Radar Imaging Satellite. India's standing in the global space market was enhanced as PSLV launched 18 commercial satellites for 11 countries. Through an inclusive organisational process, Radhakrishnan charted out clear programmatic directions and nurtured younger generation of leaders for carrying forward the legacy of ISRO. Re-defining the \"Chandrayaan-2\" mission with a lander and rover and extending the application of space technologies and tools to all central ministries are highlights of his leadership regime at ISRO. He worked to enhance the partnership with the Indian space industry for the production of operational launchers and satellites.", "The Indian Lunar Exploration Programme ( \"Chandray\u0101na\", lit: Moon vehicle ), also known as the Chandrayaan programme, is an ongoing series of outer space missions by the Indian Space Research Organisation (ISRO). The programme incorporates a lunar orbiter and future lunar lander & rover spacecraft. The Chandrayaan (Indian Lunar Exploration Programme) programme is a multiple mission programme; as of mid-2016 only one orbiter has been sent to the Moon, using ISRO's workhorse PSLV rocket. The second spacecraft is being readied for an early 2019 launch using the GSLV rocket. The first phase includes the launch of the first lunar orbiters. The second phase, under preparation as of 2018, will incorporate spacecraft capable of soft-landing on the Moon and will also deploy a robotic rover on the lunar surface.", "India has launched 239 satellites for 28 different countries as of October, 2018. Commercial launches for foreign nations are negotiated through Antrix, the commercial arm of the Indian Space Research Organization (ISRO). All satellites were launched using the ISRO's Polar Satellite Launch Vehicle (PSLV) expendable launch system. Between 2013 and 2015, India launched 28 foreign satellites for 13 different countries earning a total revenue of US$101 million. ISRO successfully launched 104 satellites by a single rocket on 15 February 2017, of which 3 satellites are Indian satellites while the remaining are foreign commercial satellites. Ninety-six satellites are from the United States, while the others come from Israel, the UAE, Kazakhstan, the Netherlands, Belgium and Germany. It is the largest number of satellites launched on a single flight by any space agency. The previous record was held by Russia's Dnepr launcher which launched 37 in June 2014. Total Foreign Satellites launched by ISRO : 269 (as of 29/11/2018) ----
", "A military satellite is an artificial satellite used for a military purpose. The most common missions are intelligence gathering, navigation and military communications. The first military satellites were photographic reconnaissance missions. Some attempts were made to develop satellite based weapons but this work was halted in 1967 following the ratification of international treaties banning the deployment of weapons of mass destruction in orbit. As of 2013, there are 950 satellites of all types in Earth orbit. It is not possible to identify the exact number of these that are military satellites partly due to secrecy and partly due to dual purpose missions such as GPS satellites that serve both civilian and military purposes. As of December 2018, there are 320 mulitary or dual use satellites in the sky, half of which are owned by USA, followed by Russia, China and India (13).", "Prime Minister of India, Sri Narendra Modi, announced in his Independence Day address of August 15, 2018 that India will send astronauts into space by 2022 through the \"Gaganyaan\" mission. After the announcement, ISRO chairman, Sivan, said ISRO has developed most of the technologies needed such as crew module and crew escape system, and that the project would cost less than Rs. 10,000 crore and would include sending at least 3 Indians to space, 300\u2013400 km above in a spacecraft for at least 7 days using a GSLV Mk-III launch vehicle.", "A program of automated return vehicles was begun, in the hope of being the first to return lunar rocks. This had several failures. It eventually succeeded with Luna 16. But this had little impact, because the Apollo 11 and Apollo 12 lunar landings and rock returns had already taken place by then. In total, twenty-four U.S. astronauts have traveled to the Moon. Three have made the trip twice, and twelve have walked on its surface. Apollo 8 was a lunar-orbit-only mission, Apollo 10 included undocking and Descent Orbit Insertion (DOI), followed by LM staging to CSM redocking, while Apollo 13, originally scheduled as a landing, ended up as a lunar fly-by, by means of free return trajectory; thus, none of these missions made landings. Apollo 7 and Apollo 9 were Earth-orbit-only missions. Apart from the inherent dangers of manned Moon expeditions as seen with Apollo 13, one reason for their cessation according to astronaut Alan Bean is the cost it imposes in government subsidies."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[804, 806], [19, 22], [786, 789], [466, 469], [94, 96], [416, 419], [553, 554], [885, 887], [429, 430], [308, 319]], "rd_topk": 1}, "test_2020": {"question": "Where was because I could not stop for death published", "answer": ["Poems : Series 1", "1890"], "prediction": ["Italy on 27 October 1972 in Italy", "Italy", "Italy", "US", "US", "1986", "New York", "United Kingdom", "States", "the United States"], "score": [73.95896911621094, 73.81816101074219, 73.61072540283203, 73.00140380859375, 72.61085510253906, 72.56147766113281, 72.44778442382812, 72.41390991210938, 72.15495300292969, 72.13128662109375], "title": [["A Reason to Live, a Reason to Die"], ["A Reason to Live, a Reason to Die"], ["A Reason to Live, a Reason to Die"], ["The A.B.C. Murders"], ["Appointment with Death"], ["I Can't Stop (Gary Numan song)"], ["A Matter of Life and Death (film)"], ["Chasing the Scream"], ["Can't Stop (album)"], ["Death to the World"]], "evidence": ["\"A Reason to Live, A Reason to Die\" was released in Italy on 27 October 1972 in Italy where it was distributed by Cidif. The film had a domestic gross of 1,960,071,000 Italian lire. The film was later released on 27 December 1972 in West Germany, 6 August 1973 in Spain, and 29 May 1974 in France. It received a released in the United States 1974 August 28. It was also released as \"Massacre at Fort Holman\". In his investigation of narrative structures in Spaghetti Western films, Fridlund discusses \"A Reason to Live, a Reason to Die\" mostly in terms of the \"infiltrator\" plot introduced in A Fistful of Dollars, where The Man With No Name joins a gang with hidden agendas of his own. Eli is an infiltrator entering the fort and piling one false motive on top of the other to cover his true intentions. In fact, the same goes for Pembroke - pitting his rather involuntary companions against the Confederates with a false monetary motive beside the official, to re-conquer Ft Holman for the Union, while his real hidden motive is vengeance. Wild East has released the full uncut version with around 30 minutes extra footage on an out-of-print limited edition R0 NTSC DVD in the film's original widescreen aspect ratio with the title \"A Reason to Live, a Reason to Die\". List of films shot in Almer\u00eda", "\"A Reason to Live, A Reason to Die\" was released in Italy on 27 October 1972 in Italy where it was distributed by Cidif. The film had a domestic gross of 1,960,071,000 Italian lire. The film was later released on 27 December 1972 in West Germany, 6 August 1973 in Spain, and 29 May 1974 in France. It received a released in the United States 1974 August 28. It was also released as \"Massacre at Fort Holman\". In his investigation of narrative structures in Spaghetti Western films, Fridlund discusses \"A Reason to Live, a Reason to Die\" mostly in terms of the \"infiltrator\" plot introduced in A Fistful of Dollars, where The Man With No Name joins a gang with hidden agendas of his own. Eli is an infiltrator entering the fort and piling one false motive on top of the other to cover his true intentions. In fact, the same goes for Pembroke - pitting his rather involuntary companions against the Confederates with a false monetary motive beside the official, to re-conquer Ft Holman for the Union, while his real hidden motive is vengeance. Wild East has released the full uncut version with around 30 minutes extra footage on an out-of-print limited edition R0 NTSC DVD in the film's original widescreen aspect ratio with the title \"A Reason to Live, a Reason to Die\". List of films shot in Almer\u00eda", "\"A Reason to Live, A Reason to Die\" was released in Italy on 27 October 1972 in Italy where it was distributed by Cidif. The film had a domestic gross of 1,960,071,000 Italian lire. The film was later released on 27 December 1972 in West Germany, 6 August 1973 in Spain, and 29 May 1974 in France. It received a released in the United States 1974 August 28. It was also released as \"Massacre at Fort Holman\". In his investigation of narrative structures in Spaghetti Western films, Fridlund discusses \"A Reason to Live, a Reason to Die\" mostly in terms of the \"infiltrator\" plot introduced in A Fistful of Dollars, where The Man With No Name joins a gang with hidden agendas of his own. Eli is an infiltrator entering the fort and piling one false motive on top of the other to cover his true intentions. In fact, the same goes for Pembroke - pitting his rather involuntary companions against the Confederates with a false monetary motive beside the official, to re-conquer Ft Holman for the Union, while his real hidden motive is vengeance. Wild East has released the full uncut version with around 30 minutes extra footage on an out-of-print limited edition R0 NTSC DVD in the film's original widescreen aspect ratio with the title \"A Reason to Live, a Reason to Die\". List of films shot in Almer\u00eda", "The first true publication of \"The A.B.C. Murders\" occurred in the US with an abridged version appearing in the November 1935 (Volume XCIX, Number 5) issue of \"Cosmopolitan\" magazine with illustrations by Frederic Mizen. The UK serialisation was in sixteen parts in the \"Daily Express\" from Monday, 28 November to Thursday, 12 December 1935. All the instalments carried an illustration by Steven Spurrier. This version did not contain any chapter divisions and totally omitted the foreword as well as chapters twenty-six, thirty-two and thirty-five. In addition most of chapters seven and twenty were missing. Combined with other abridgements, this serialisation omitted almost 40% of the text of the published novel.", "The first true publication of \"Appointment with Death\" occurred in the US with a nine-part serialisation in \"Collier's Weekly\" from 28 August (Volume 100, Number 9) to 23 October 1937 (Volume 100, Number 17) with illustrations by Mario Cooper. The UK serialisation was in twenty-eight parts in the \"Daily Mail\" from Wednesday, 19 January to Saturday, 19 February 1938 under the title of \"A Date with Death\". Fifteen of the instalments contained illustrations by J. Abbey (Joseph van Abb\u00e9, brother of Salomon van Abb\u00e9). This version did not contain any chapter divisions and omitted various small paragraphs such as the quote in Part I, Chapter twelve from Dr Gerard which is taken from Book IV of \"Ecclesiastes\". The political argument between Lady Westholme and Dr Gerard in chapter ten about the League of Nations was also deleted. Finally, the epilogue did not appear in the serialisation.", "\"I Can't Stop\" is a song by English musician Gary Numan, released in 1986 as the second single from his eighth studio album \"Strange Charm\". It was written by Numan, and produced by Numan and the Waveteam. \"I Can't Stop\" reached No. 27 in the UK and remained on the charts for four weeks. A music video was filmed to promote the single. The nightclub performance footage was shot at Kadek TV (adjoining Shepperton Studios), while the footage of Numan flying his Harvard plane was filmed at Duxford Aerodrome. Speaking to \"Sound on Sound\" in 1986, Numan said: \"The flying sequences were done with a minicam attached to the engine cowling of the plane and pointing into the cockpit. I had a trigger in one hand to start the camera shooting.\"", "Other sequences also presented challenges, such as the stopped-action table-tennis game for which Hunter and Livesey were trained by champions Alan Brooke and Viktor Barna; the scene where Carter washes up on the beach, the first scene filmed, where cinematographer Jack Cardiff fogged up the camera lens with his breath to create the look he wanted; and the long, 25-minute trial sequence, which required a set with a long by high backcloth. \"A Matter of Life and Death\" was chosen for the first ever Royal Film Performance on 1 November 1946 at the Empire Theatre, in London. The performance was in aid of the Cinematograph Trade Benevolent Fund and \u00a330,000 (\u00a3 in 2020 pounds) was raised. It then went into general release in the UK on 15 December 1946. The film subsequently had its US release in New York on 25 December 1946 under the name \"Stairway to Heaven\".", "Chasing the Scream: The First and Last Days of the War on Drugs is a book by British writer and journalist Johann Hari examining the history and impact of drug criminalisation, collectively known as \"the War on Drugs.\" The book was published simultaneously in the United Kingdom and United States in January 2015. In January 2012, Hari announced on his website that he was writing his first book, a study of the \"war on drugs.\" The release of the book coincided with the 100th anniversary of the Harrison Narcotics Tax Act in the United States, which was the world's first drug control legislation when it passed in December 1914. In \"Chasing the Scream\", Hari writes that two global wars began in 1914: World War I, which lasted four years, and the war on drugs, which is ongoing.", "Of the $630,000 awarded by the jury, US District Judge Jed Rakoff rejected all but $50,000 of the award on the grounds that the jurors did not have adequate facts to determine damages so they were left to speculate. Ashanti sought an injunction to block the release and damages in excess of $1 million. September 19, 2006, Ashanti has settled a lawsuit with her first producer, Genard Parker, out of court on Tuesday, dropping all litigation in their contract dispute. \"Can\u2019t Stop\" was first released in 2004 and then on January 25, 2006 in United States. It was re-released multiple times under different labels throughout 2007. It was released on May 31, 2012 for digital download in United Kingdom only.", "Death To The World is an Eastern Orthodox zine published in the United States. \"Death to the World\" was started by monks and nuns from the St Herman of Alaska Monastery in Platina, California, as a medium of evangelism to teens involved in the punk subculture by monastics who were ex-punks. A founding member was Justin Marler who, soon after recording \"Volume One\" with seminal doom metal band Sleep in 1991, left for seven years of monastic life while Sleep went on to become metal icons. Originally, the monastics planned to submit an article about Fr. Seraphim Rose to the magazine \"Maximum RocknRoll\". They later decided to try to place an ad for their monastery, but were only rudely rejected, being told that the magazine \"only [ran] ads for music and zines\". This inspired them to begin a zine."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[52, 85], [52, 57], [80, 85], [67, 69], [71, 73], [69, 73], [800, 808], [264, 278], [548, 554], [60, 77]], "rd_topk": 1}, "test_2021": {"question": "Who came out first Batman or spider man", "answer": ["Batman", "Superman"], "prediction": ["Batman", "Batman, as the main protagonist. Since Batman", "Batman", "Spider-Man", "Batman", "Batman", "Spider-Man", "Spider-Man", "Batman", "Spider-Man"], "score": [86.76481628417969, 86.412353515625, 86.13221740722656, 85.81401062011719, 85.61212921142578, 85.28598022460938, 85.12309265136719, 84.51982116699219, 83.92500305175781, 83.84391021728516], "title": [["Batman (1966 film)"], ["List of Batman supporting characters"], ["Spider-Man (2018 video game)"], ["Spider-Man (2002 film)"], ["Batman (1989 film)"], ["List of Batman supporting characters"], ["The Sensational Spider-Man"], ["Competition (The Spectacular Spider-Man)"], ["List of Batman creators"], ["The Spectacular Spider-Man"]], "evidence": ["Batman (often promoted as Batman: The Movie) is a 1966 American superhero film based on the \"Batman\" television series, and the first full-length theatrical adaptation of the DC Comics character Batman. Released by 20th Century Fox, the film starred Adam West as Batman and Burt Ward as Robin. The film hit theaters two months after the of the television series. The film includes most members of the original TV cast, with the exception of Lee Meriwether as Catwoman, the character previously played by Julie Newmar in two episodes of the series' first season.", "The Batman supporting characters are a collective of fictional characters appearing in American comic books published by DC Comics featuring the superhero, Batman, as the main protagonist. Since Batman's introduction in 1939, the character has accumulated a number of recognizable supporting characters. The first Batman supporting character was Commissioner James Gordon, who first appeared in the same comic book as Batman in \"Detective Comics\" #27 (May 1939), and is Batman's ally in the Gotham City Police Department. Robin, Batman's vigilante partner, was introduced in the Spring of 1940, Alfred Pennyworth, Batman's butler, was introduced in 1943, and Barbara Gordon was introduced in 1967.", "\"Spider-Man\" received \"generally favorable\" reviews according to review aggregator Metacritic. The game received praise for its gameplay, graphics, narrative, and characterization, while being criticized for familiar open-world tropes and lack of innovation. Critics called \"Spider-Man\" one of the greatest superhero games ever made. Mike Minotti of \"VentureBeat\" called it \"the best Spider-Man game ... and one of the best super hero games ever\", while \"Game Informer\"s Andrew Reiner wrote \"Like \"Batman: Arkham Asylum\" before it, \"Spider-Man\" raises the bar for one of the world\u2019s most beloved heroes\".", "International markets which generated grosses in excess of $10 million include Australia ($16.9 million), Brazil ($17.4 million), France, Algeria, Monaco, Morocco and Tunisia ($32.9 million), Germany ($30.7 million), Italy ($20.8 million), Japan ($56.2 million), Mexico ($31.2 million), South Korea ($16.98 million), Spain ($23.7 million), and the United Kingdom, Ireland and Malta ($45.8 million). \"Spider-Man\" became the highest-grossing superhero film of all time at the time of its release, both domestically and worldwide. Its domestic gross was eventually topped by \"The Dark Knight\" (2008). Its worldwide gross was first surpassed by \"Spider-Man 3\" (2007).", "The success of \"Batman\" prompted Warner Bros. Animation to create the acclaimed \"\", as a result beginning the long-running DC animated universe and helped establish the modern day superhero film genre. Series co-creator Bruce Timm stated the television show's Art Deco design was inspired from the film. Timm commented, \"our show would never have gotten made if it hadn't been for that first \"Batman\" movie.\" Burton joked, \"ever since I did \"Batman\", it was like the first dark comic book movie. Now everyone wants to do a dark and serious superhero movie. I guess I'm the one responsible for that trend.\"", "The Batman supporting characters are a collective of fictional characters appearing in American comic books published by DC Comics featuring the superhero, Batman, as the main protagonist. Since Batman's introduction in 1939, the character has accumulated a number of recognizable supporting characters. The first Batman supporting character was Commissioner James Gordon, who first appeared in the same comic book as Batman in \"Detective Comics\" #27 (May 1939), and is Batman's ally in the Gotham City Police Department. Robin, Batman's vigilante partner, was introduced in the Spring of 1940, Alfred Pennyworth, Batman's butler, was introduced in 1943, and Barbara Gordon was introduced in 1967.", "The Sensational Spider-Man is a comic book series starring Spider-Man published by Marvel Comics for 35 issues (#0\u201333, with # -1 published in July 1997 between #17 and #18), from January 1996 until November 1998. \"The Sensational Spider-Man\" title was first used for various reprints, including \"Marvel Treasury Edition\" #14 (1977), 22 (1979) and 27 (1980) which featured various reprints from \"Marvel Team-Up\" and \"The Amazing Spider-Man\", a trade paperback in 1988 featuring Frank Miller's Spider-Man work, and a prestige format one-shot special called \"The Sensational Spider-Man: Nothing Can Stop the Juggernaut\" () in 1989 which reprinted \"The Amazing Spider-Man\" issues #229 and #230.", "\"Competition\" the fifth episode of the animated television series \"The Spectacular Spider-Man\", which is based on the comic book character Spider-Man, created by Stan Lee and Steve Ditko. In it, Spider-Man must face the Sandman, a former petty thug who now can manipulate his sand body at will. \"Competition\" was written by Kevin Hopps and directed by Troy Adomitis. Hopps and Adomotis each had their respective roles previously in \"Interactions.\" Victor Cook, a developer, producer, and supervising director for \"The Spectacular Spider-Man,\" was thrilled to use Sandman because he felt he was \"a perfect character for animation.\" \"Competition\" aired on March 29, 2008, on the Kids WB! block for The CW. The episode received warm reviews from television critics - IGN wrote that the fight scenes were the greatest of the series at the time.", "Although Bob Kane achieved renown for creating the fictional superhero Batman, he and others have acknowledged the contributions of Bill Finger for fleshing the character out, writing many of his early stories, and creating the character's origin. Many other comic book creators (writers, artists, and sometimes editors who contributed important ideas or altered how the character would be presented) have contributed to the character's history since Batman's introduction in \"Detective Comics\" #27 in 1939. This list identifies some who made contributions with enduring impact. This is an incomplete list. The following list is of people who have both written and drawn Batman comics.", "The Spectacular Spider-Man is the name of several comic books and one magazine series starring Spider-Man and published by Marvel Comics. Following the success of Spider-Man's original series, \"The Amazing Spider-Man\", Marvel felt the character could support more than one title. This led the company in 1968 to launch a short-lived magazine, the first to bear the \"Spectacular\" name. In 1972, Marvel more successfully launched a second Spider-Man ongoing series, \"Marvel Team-Up\", in which he was paired with other Marvel heroes. A third monthly ongoing series, \"Peter Parker, The Spectacular Spider-Man\", debuted in 1976."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[195, 201], [156, 201], [498, 504], [400, 410], [393, 399], [195, 201], [59, 69], [139, 149], [451, 457], [163, 173]], "rd_topk": 5}, "test_2022": {"question": "Who does the vocals for feel it still", "answer": ["Portugal . The Man"], "prediction": ["Portugal. The Man", "American rock band Portugal. The Man", "Collin Raye", "Ryan Tedder", "Seiji Motoyama.", "Mike Di Scala", "Dave Dexter, Jr.", "Jason Falkner,", "Jay Sean", "Noddy Holder"], "score": [84.01165771484375, 82.373046875, 79.25555419921875, 79.03926086425781, 78.7957534790039, 78.19883728027344, 77.96723175048828, 77.96379089355469, 77.74697875976562, 77.73050689697266], "title": [["Feel It Still"], ["Feel It Still"], ["I Can Still Feel You"], ["Feel Again"], ["Still (Lead song)"], ["Feel It with Me"], ["I Feel Fine"], ["Can You Still Feel?"], ["When You Feel This"], ["How Does It Feel (Slade song)"]], "evidence": ["\"Feel It Still\" is a song by American rock band Portugal. The Man. The song, which has interpolations from The Marvelettes' 1961 hit \"Please Mr. Postman\", was written by the band along with John Hill and Asa Taccone, with the latter two serving as producers. It serves as the second single and first radio single off their eighth studio album \"Woodstock\". The song reached number one on the US Alternative Songs, Mexican and Russian Tophit airplay chart, and became their first entry on the US \"Billboard\" Hot 100, reaching number four as of October 2017. It was also featured in advertisements for the Apple iPad Pro, Vitamin Water, YouTube TV, Graton Resort & Casino, Haven Holidays and in a BBC TV trailer for Radio 2 and the first and second trailers for the 2018 film \"Peter Rabbit\".", "\"Feel It Still\" is a song by American rock band Portugal. The Man. The song, which has interpolations from The Marvelettes' 1961 hit \"Please Mr. Postman\", was written by the band along with John Hill and Asa Taccone, with the latter two serving as producers. It serves as the second single and first radio single off their eighth studio album \"Woodstock\". The song reached number one on the US Alternative Songs, Mexican and Russian Tophit airplay chart, and became their first entry on the US \"Billboard\" Hot 100, reaching number four as of October 2017. It was also featured in advertisements for the Apple iPad Pro, Vitamin Water, YouTube TV, Graton Resort & Casino, Haven Holidays and in a BBC TV trailer for Radio 2 and the first and second trailers for the 2018 film \"Peter Rabbit\".", "\"I Can Still Feel You\" is a song written by Kim Tribble and Tammy Hyler, and recorded by American country music singer Collin Raye that reached the top of the \"Billboard\" Hot Country Songs chart. It was released in April 1998 as the first single from his album \"The Walls Came Down\". \"I Can Still Feel You\" is in cut time and the key of E major. Raye's vocals range from E4 to B5. Chuck Taylor, of \"Billboard\" magazine reviewed the song favorably saying it boasts a \"strong lyric, a memorable melody, and an outstanding vocal performance\".", "The song received a favorable reception from music critics. Arjan Writers gave a very positive review for the track, stating that \"Feel Again represents everything fans have come to love about the group, it clearly demonstrates that the group is evolving their brand of pop.\" The review further added: \"In world saturated by bleak news headlines, conveying a message of living life in the moment is a timeless concept that truly has a universal appeal. And leave it up to Tedder and his friends to package such a powerful sentiment in a tightly-produced and radio-ready package that has the potential to spread like wildfire.\" Sam Wilbur of AOL Radio followed the same thought, writing, \"The single is destined to be a top radio hit and a live favorite, with its hand-clapping beats and enjoyable chorus.\" Huw Hopkins of Alt Sounds commented, \"The main chorus melody is wonderfully catchy and would make a brilliant sing-along at larger festivals. There is a certain soul to the voice of Ryan Tedder, but the production skills and teamwork of Zach Filkins adds an extra kick on the choral backing vocals.\"", "The title track \"Still\" was written by Canadian DJ and record producer Vincent DeGiorgio, and Swedish songwriter Anderz Wrethov, with the lyrics written by the members of Lead. The music was performed by Seiji Motoyama. Vincent has worked in the music industry since the 1980s and has worked with many well-known artists, including Utada Hikaru, Petula Clark and Caro Emerald. Anderz Wrethov, who goes by his stage name \"Wrethov\", began his career in 1999 and has worked with the likes of Arashi, KAT-TUN and Super Junior.", "\"Feel It With Me\" is the fourth Ultrabeat single. It was released in September 2005 and it reached #57 in the charts. It is the only Ultrabeat song to date that has not reached the Top 40 in the charts and is the lowest charting Ultrabeat song. It is the last of the Ultrabeat singles, so far, that has Mike Di Scala on vocals. The song was brought out on CD and 12 inch and artists who remixed this track were Styles & Breeze, Friday Night Posse, Flip & Fill, and Hixxy. The video starts with a girl in the back of a taxi, she is on her mobile phone and is looking out of the window. Then it show her legs as she steps out of the taxi and then moves on to another woman wearing a yellow dress on the catwalk in a fashion show.", "In the United States, the song was released on the Capitol album \"Beatles '65.\" The mono version \u2014 also released as a single on Capitol \u2013 features an exclusive mix with added reverb and a shorter fade as created by Beatles producer George Martin. The stereo version of the LP presented a duophonic mix featuring a layer of reverb added by executive Dave Dexter, Jr. In the United Kingdom, the song was released on the LP format on \"A Collection of Beatles Oldies\". A true stereo version can be found on the \"Past Masters Volume 1\" and \"1\" CDs. There is also another stereo version (virtually identical to the standard stereo mix) wherein whispering can be heard at the beginning of the track. This \"whispering version\" appears on the non-US release of \"1962\u20131966\", as well as on occasional single re-releases. An outtake in mono is included in the \"On Air \u2013 Live at the BBC Volume 2\" compilation released in 2013.", "Can You Still Feel? is the sophomore studio album by Jason Falkner, released on February 23, 1999 by Elektra Entertainment. It was produced by Falkner and Nigel Godrich. The album was supported with singles for the songs \u201cHoliday\u201d, \u201cEloquence\u201d, and \u201cMy Lucky Day\u201d. Falkner's recording contract with Elektra came to an end after the album was met with weak sales numbers. It would be his last solo album for nearly a decade. Due to the lack of commercial success of his debut album, \"Presents Author Unknown\", Falkner requested to be dropped by his label Elektra Records. Falkner felt the album could have had a \u201cmuch, much larger audience\u201d and felt that the label\u2019s lack of promotion was to blame for its disappointing sales. However, according to Falkner, the label took responsibility for the album\u2019s lack of success and requested that he record another album in the same manner he had recorded his debut.", "\"When You Feel This\" is a song by Australian DJs and producers Stafford Brothers with Rick Ross featuring Jay Sean. It was released as a single in Australia on 10 July 2015. The song peaked at number 12 on the Australian Dance Chart, number 9 on the Australian Artists chart and number 70 on the overall Australian Singles Chart, A remix EP was released on 28 September 2015. Petey Mac of Your EDM said the song was \"a gem\", saying \"[Stafford Brothers] incorporate a bit of drum 'n' bass into the mix as Jay Sean\u2019s iconic voice hooks you instantly. It builds into a beautiful, half time groove reminiscent of early Adventure Club, with a euphoric taste. Ricky Rozay takes over, setting a record for only calling himself a boss once, and absolutely kills the verse", "\"How Does It Feel\" is song by the British rock band Slade, released in 1975 as the second single from the band's first soundtrack album and fifth studio album \"Slade in Flame\", in promotion of the film of the same name. The song was written by lead vocalist Noddy Holder and bassist Jim Lea, and produced by Chas Chandler. It reached No. 15 in the UK, remaining in the charts for seven weeks. By 1974, Slade had become a big success in the UK, Europe and beyond; however the band felt that continuing to provide 'more of the same' was not what they wanted to do. Their manager Chas Chandler suggested they do a movie, to which the band agreed. To accompany the film, Holder and Lea began writing material for a soundtrack album, which would continue to see the band break out of their successful formula and try different musical ideas. In late 1974, the lead single \"Far Far Away\" had reached No. 2, while \"Slade in Flame\" peaked at No. 6. Following the film's release in January 1975, it was decided to release \"How Does It Feel\" as the second single the following month. It reached No. 15, which was the band's first single not to reach the UK Top 5 since their 1971 breakthrough with \"Get Down and Get with It\"."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[48, 65], [29, 65], [119, 130], [988, 999], [204, 219], [303, 316], [349, 365], [53, 67], [106, 114], [258, 270]], "rd_topk": 1}, "test_2023": {"question": "Who sang heard it thru the grapevine first", "answer": ["Gladys Knight & the Pips", "The Miracles", "the Miracles"], "prediction": ["Gladys Knight & the Pips", "the Miracles", "The Miracles", "Miracles", "Marvin Gaye", "Pips", "Marvin Gaye", "Marvin Gaye", "Marvin Gaye", "Marvin Gaye"], "score": [85.1848373413086, 83.81956481933594, 82.4110107421875, 81.32797241210938, 76.07115173339844, 74.98565673828125, 74.71589660644531, 74.6446533203125, 74.1533203125, 74.13760375976562], "title": [["I Heard It Through the Grapevine"], ["I Heard It Through the Grapevine"], ["I Heard It Through the Grapevine"], ["I Heard It Through the Grapevine"], ["Johnny Griffith (musician)"], ["I Heard It Through the Grapevine"], ["The California Raisins"], ["I Heard It Through the Grapevine"], ["I Heard It Through the Grapevine"], ["The Funk Brothers"]], "evidence": ["\"I Heard It Through the Grapevine\" is a song written by Norman Whitfield and Barrett Strong for Motown Records in 1966. The first recording of the song to be released was produced by Whitfield for Gladys Knight & the Pips and released as a single in September 1967; it went to number two in the \"Billboard\" chart. The Miracles recorded the song first and included their version on their 1968 album, \"Special Occasion\". The Marvin Gaye version was placed on his 1968 album \"In the Groove\", where it gained the attention of radio disc jockeys, and Motown founder Berry Gordy finally agreed to its release as a single in October 1968, when it went to the top of the \"Billboard\" Pop Singles chart for seven weeks from December 1968 to January 1969 and became for a time the biggest hit single on the Motown label (Tamla).", "Producer Norman Whitfield recorded \"I Heard It Through the Grapevine\" with various Motown artists. The first known recording is with the Miracles on August 6, 1966, though there may also have been a recording with the Isley Brothers, or at least Whitfield intended to record it with them; however a track has not turned up \u2013 some Motown historians believe that a session may have been scheduled but cancelled. The Miracles' version was not released as a single due to Berry Gordy's veto during Motown's weekly quality control meetings; Gordy advised Whitfield and Strong to create a stronger single. The Miracles version later appeared on their 1968 \"Special Occasion\" album, and a slightly different take, possibly from the same session but unreleased, appeared on the 1998 compilation album, \"Motown Sings Motown Treasures\".", "\"I Heard It Through the Grapevine\" is a song written by Norman Whitfield and Barrett Strong for Motown Records in 1966. The first recording of the song to be released was produced by Whitfield for Gladys Knight & the Pips and released as a single in September 1967; it went to number two in the \"Billboard\" chart. The Miracles recorded the song first and included their version on their 1968 album, \"Special Occasion\". The Marvin Gaye version was placed on his 1968 album \"In the Groove\", where it gained the attention of radio disc jockeys, and Motown founder Berry Gordy finally agreed to its release as a single in October 1968, when it went to the top of the \"Billboard\" Pop Singles chart for seven weeks from December 1968 to January 1969 and became for a time the biggest hit single on the Motown label (Tamla).", "Producer Norman Whitfield recorded \"I Heard It Through the Grapevine\" with various Motown artists. The first known recording is with the Miracles on August 6, 1966, though there may also have been a recording with the Isley Brothers, or at least Whitfield intended to record it with them; however a track has not turned up \u2013 some Motown historians believe that a session may have been scheduled but cancelled. The Miracles' version was not released as a single due to Berry Gordy's veto during Motown's weekly quality control meetings; Gordy advised Whitfield and Strong to create a stronger single. The Miracles version later appeared on their 1968 \"Special Occasion\" album, and a slightly different take, possibly from the same session but unreleased, appeared on the 1998 compilation album, \"Motown Sings Motown Treasures\".", "John Ellis \"Johnny\" Griffith Jr. (July 10, 1936 \u2013 November 10, 2002) was an African-American musician. Born in Detroit, Griffith played piano and keyboards for Motown Records' in-house Funk Brothers studio band. Among the hundreds of Motown recordings Griffith played on are \"I Heard It Through the Grapevine\" by Marvin Gaye, \"I Can't Help Myself (Sugar Pie, Honey Bunch)\" by Four Tops, \"Stop! In the Name of Love\" by The Supremes, \"Shotgun\" by Junior Walker & the All Stars and \"Papa Was a Rolling Stone\" by The Temptations. Griffith played the Steinway grand piano, the Hammond B-3 organ, the Wurlitzer electric piano, the Fender Rhodes, and the celeste and harpsichord. His musical influences included Bud Powell, Glenn Gould, and Oscar Peterson. Griffith died of a heart attack in a Detroit hospital on November 10, 2002. He was 66 years old.", "Due to the song's success, \"In the Groove\" was re-issued as \"I Heard It Through the Grapevine\" and peaked at number two on the R&B album chart and number sixty-three on the album chart, which was at the time Marvin's highest-charted solo studio effort to date. Because of the success of both versions, \"I Heard It Through the Grapevine\" was the first and last number one on the \"Billboard\" R&B chart in 1968: the Pips version was the first week of January, the Gaye version the last week of December. Gladys Knight was not pleased that Gaye's version usurped her own, and claimed that Gaye's version was recorded over an instrumental track Whitfield had prepared for a Pips song, an allegation Gaye denied. In 1985, one year following Gaye's death, the song was re-released in the UK reaching number eight thanks to a Levi's commercial (starring Nick Kamen).", "The California Raisins were a fictional rhythm and blues animated musical group as well as advertising and merchandising characters composed of anthropomorphized raisins. Lead vocals were sung by musician Buddy Miles. The California Raisins concept experienced high popularity in the mid-to-late 1980s principally through claymation TV commercials and animated specials, winning an Emmy Award and one nomination. The concept was originally created for a 1986 Sun-Maid commercial on behalf of the California Raisin Advisory Board when one of the writers, Seth Werner (at the time with the advertising firm Foote, Cone & Belding SF, and now with big) came up with an idea for the new raisin commercial, saying, \"We have tried everything but dancing raisins singing 'I Heard It Through the Grapevine'\" (the 1968 song popularized by Marvin Gaye). To their surprise, the commercial became wildly popular, paving the way for several future commercials and opportunities through other media. The commercials were produced by Vinton Studios using their claymation technique, with character designs by Michael Brunsfeld. The following year, the Raisins appeared in the Emmy Award-winning \"A Claymation Christmas Celebration\", singing the Christmas carol \"Rudolph the Red-Nosed Reindeer\".", "Whitfield recorded the song with Marvin Gaye over five sessions, the first on February 3, 1967, and the last on April 10, 1967. Recordings of this version took more than a month due to Whitfield overdubbing Gaye's vocals with that of the Andantes' background vocals, mixing in several tracks featuring the Funk Brothers on the rhythm track, and adding the string section from the Detroit Symphony Orchestra with an arrangement by Paul Riser. The session featuring Gaye led to an argument between the producer and singer. Whitfield wanted Gaye to perform the song in a higher key than his normal range, a move that had worked on David Ruffin during the recording of the Temptations' hit, \"Ain't Too Proud to Beg\". The mixture of Gaye's raspy vocals and the Andantes' sweeter harmonies made Whitfield confident that he had a hit; however, despite approval from Motown's Quality Control Department, Gordy blocked the release.", "\"I Heard It Through the Grapevine\" is a song written by Norman Whitfield and Barrett Strong for Motown Records in 1966. The first recording of the song to be released was produced by Whitfield for Gladys Knight & the Pips and released as a single in September 1967; it went to number two in the \"Billboard\" chart. The Miracles recorded the song first and included their version on their 1968 album, \"Special Occasion\". The Marvin Gaye version was placed on his 1968 album \"In the Groove\", where it gained the attention of radio disc jockeys, and Motown founder Berry Gordy finally agreed to its release as a single in October 1968, when it went to the top of the \"Billboard\" Pop Singles chart for seven weeks from December 1968 to January 1969 and became for a time the biggest hit single on the Motown label (Tamla).", "In 2008 surviving members recorded \"Live in Orlando\", an album and video. In 2010, surviving members of the Funk Brothers accompanied Phil Collins on his Motown covers album, \"Going Back\", and appear in the live \"Going Back\" concert DVD. In 2010, the Funk Brothers were voted into the Michigan Rock and Roll Legends Hall of Fame. The band used innovative techniques. For example, most Motown records feature two drummers, playing together or overdubbing one another\u2014Marvin Gaye's \"I Heard It Through the Grapevine\" used three drummers. A number of songs utilized instrumentation and percussion unusual in soul music. The Temptations' \"It's Growing\" features Earl Van Dyke playing a toy piano for the song's introduction, snow chains are used as percussion on Martha and the Vandellas' \"Nowhere to Run\", and a custom oscillator was built to create the synthesizer sounds used to accent several Holland-Dozier-Holland compositions and productions, such as Diana Ross & the Supremes' \"The Happening\" and \"Reflections.\" A tire iron was used in the Martha & the Vandellas song \"Dancing in the Street\"."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[197, 221], [133, 145], [314, 326], [137, 145], [313, 324], [413, 417], [829, 840], [33, 44], [423, 434], [466, 477]], "rd_topk": 1}, "test_2024": {"question": "South African tree with thorns on the trunk", "answer": ["silk floss tree"], "prediction": ["Senegalia mellifera", "Asparagus lignosus", "Oncosperma tigilarium", "Colubrina nicholsonii", "buffalo thorn", "Vachellia erioloba", "Rhamnus", "Synsepalum brevipes", "Senegalia caffra,", "Elaeodendron transvaalensis"], "score": [85.78182220458984, 85.39519500732422, 85.24836730957031, 84.84001922607422, 84.53878784179688, 84.09319305419922, 83.97740173339844, 83.81634521484375, 83.58812713623047, 83.5037841796875], "title": [["Senegalia mellifera"], ["Asparagus lignosus"], ["Oncosperma tigillarium"], ["Colubrina nicholsonii"], ["Ziziphus mucronata"], ["Vachellia erioloba"], ["Rhamnus (genus)"], ["Synsepalum brevipes"], ["Senegalia caffra"], ["Elaeodendron transvaalensis"]], "evidence": ["Senegalia mellifera is a common thorn tree in Africa. The name \"mellifera\" refers to its sweet-smelling blossoms and honey. Its lumber turns pitch black when oiled. Common names of the tree include Blackthorn and Swarthaak (Afrikaans). It is listed as being not threatened. \"Senegalia mellifera\" is found in the dry areas of Africa and the Arabian Peninsula. \"Senegalia mellifera\" can occur either as a multi-trunked bush up to seven metres high with more or less a funnel-shaped crown, or as a single-trunked tree that can reach a height of up to nine metres. It can form an impenetrable thickets. In some areas of Africa, it is considered an invasive species as it can expand into and cover large areas of farmland.", "Asparagus lignosus (\"Katdoring\") is a thorny, spindly creeper of the Asparagus genus, that is indigenous to the south-western Cape of South Africa. It occurs in rocky sandstone slopes and fynbos vegetation in the Western Cape.", "Oncosperma tigilarium is a species of palm tree in the Arecaceae family. \"Oncosperma tigilarium\" grows to 40 feet in height in dense thickets of up to 50 palm trees. The trunks of the palms are covered with long black spines. \"Oncosperma tigilarium\" has finely pinnate leaves, with drooping leaflets. Its common name in Indonesion is \"nibung\" meaning \"thorn\", for the long thorns that arise along the length of the trunk of the palm. In parts of the Philippines it is known as \"anibung\" in the Hiligaynon language.", "Colubrina nicholsonii (Pondo weeping thorn, ) is species of tree in the family Rhamnaceae. It is a protected species endemic to South Africa. The plant grows in subpopulations in isolated gorges, usually of 10-20 and less than 50 individuals overhanging water. It is estimated that there are no more than 1,000 individuals in the wild.", "Ziziphus mucronata, known as the buffalo thorn is a species of tree in the Rhamnaceae family, native to southern Africa. The Buffalo thorn is a small to medium size tree, reaching a height of about 10 m (33 ft). It can survive in a variety of soil types, occurring in many habitats, mostly open woodlands, often on soils deposited by rivers, and grows frequently on termite mounds. Buffalo thorn has distinctive zigzag branchlets, and hooked and straight thorns. The bark is a red-brown (on young stems) or roughly mottled grey, cracked in small rectangular blocks revealing a stringy red underbark. The fruits are roughly the size of a grape, and ripen into a deep brown-red. The leaves are edible and can be cooked into spinach. The seeds can be roasted and ground as a substitute for coffee. The fruits are not very tasty, though a type of beer can be made from the fruit. The Ovambo people use it to distill \"ombike\", a traditional liquor. The leaves and fruits are also a valuable source of forage for livestock.", "Vachellia erioloba (camel thorn, giraffe thorn) is a tree of southern Africa in the family Fabaceae. Its preferred habitat is the deep dry sandy soils in parts of South Africa, Botswana, the western areas of Zimbabwe and Namibia. It is also native to Angola, south-west Mozambique, Zambia and Swaziland. The tree was first described by Ernst Heinrich Friedrich Meyer and Johann Franz Dr\u00e8ge in 1836. The camel thorn is a protected tree in South Africa. The tree can grow up to 17 metres high. It is slow-growing, very hardy to drought and fairly frost-resistant. The wood is dark reddish-brown in colour and extremely dense and strong. It is good for fires, which leads to widespread clearing of dead trees and the felling of healthy trees. It produces ear-shaped pods, favoured by a large number of herbivores including cattle. The seeds can be roasted and used as a substitute for coffee beans. The name 'camel thorn' refers to the fact that giraffe (\"kameelperd\" in Afrikaans) commonly feed on the leaves with their specially-adapted tongue and lips that can avoid the thorns. The scientific name 'erioloba' means \"wooly lobe\", a reference to the ear-shaped pods", "Rhamnus is a genus of about 110 accepted species of shrubs or small trees, commonly known as buckthorns, in the family Rhamnaceae. Its species range from 1 to 10 meters tall (rarely to 15 m) and are native mainly in east Asia and North America, but found throughout the temperate and subtropical Northern Hemisphere, and also more locally in the subtropical Southern Hemisphere in parts of Africa and South America. Both deciduous and evergreen species occur. The leaves are simple, 3 to 15 centimeters long, and arranged alternately, in opposite pairs, or almost paired (subopposite). One distinctive character of many buckthorns is the way the veination curves upward towards the tip of the leaf. The plant bears fruits which are black or red berry-like drupes. The name is due to the woody spine on the end of each twig in many species.", "Synsepalum brevipes is a shrub or medium-sized to large tree in the family Sapotaceae, that is native to the African tropics and subtropics. It occurs in the African tropics and in subtropical lowlands from Angola to Zimbabwe and Mozambique. It occurs in dry evergreen forest or as a component of riparian vegetation. Damaged wood or bark exudes a milky latex, and the bark's slash mark is red. Twigs and young leaves have a downy texture. The sweet-scented flowers are produced from late summer to autumn. Edible fruit appear in late winter and contain one smooth seed.", "Senegalia caffra, also known as hook-thorn or Acacia caffra, is a tree that occurs commonly in southern Africa. Though it is cultivated, it often occurs naturally in Gauteng suburban gardens, together with \"Acacia karroo\" and \"Acacia robusta\". It is up to tall and may be found in open woodland, grassland, rocky hillsides or watercourses. It occurs in the Transvaal, Swaziland, KwaZulu-Natal, Cape Province and the southern regions of Botswana, Zimbabwe and Mozambique. It has extremely hard, dense and attractive timber, and is only spared from intense exploitation because of its strongly twisted trunk which does not lend itself to long planks, and its tendency to develop heart rot. The bark is rough, dark grey and flaking, while the strong, paired hooked thorns are a formidable deterrent on young plants. Twigs which may vary in hairiness from densely puberulous to pubescent or tomentose. Due to its variability the species has been described under many names, some being listed below.", "Elaeodendron transvaalensis (bushveld saffron, , \"Lepelhout\", or \"Oupitjie\", , , ) is a protected tree in South Africa. It also occurs in other Southern African countries like Angola, Namibia, Botswana, Zambia, Zimbabwe, Swaziland and Mozambique."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[0, 19], [0, 18], [0, 21], [0, 21], [33, 46], [0, 18], [0, 7], [0, 19], [0, 17], [0, 27]], "rd_topk": 1}, "test_2025": {"question": "Who made the nuclear model of an atom", "answer": ["Ernest Rutherford"], "prediction": ["Ernest Rutherford", "Hantaro Nagaoka", "Ernest Rutherford", "Hantaro Nagaoka", "Ernest Rutherford", "Niels Bohr", "Ernest Rutherford", "John Dalton", "Werner Heisenberg", "Ernest Rutherford"], "score": [101.43742370605469, 99.83567810058594, 99.70153045654297, 99.03446960449219, 97.63178253173828, 97.5508041381836, 97.1710205078125, 97.14506530761719, 96.68995666503906, 96.39199829101562], "title": [["Quantum mechanics"], ["History of chemistry"], ["Rutherford model"], ["20th century in science"], ["Nuclear fission"], ["The Value of Science"], ["Atomic number"], ["Atomic, molecular, and optical physics"], ["Neutron"], ["Discovery of the neutron"]], "evidence": ["Following Max Planck's solution in 1900 to the black-body radiation problem (reported 1859), Albert Einstein offered a quantum-based theory to explain the photoelectric effect (1905, reported 1887). Around 1900\u20131910, the atomic theory and the corpuscular theory of light first came to be widely accepted as scientific fact; these latter theories can be viewed as quantum theories of matter and electromagnetic radiation, respectively. Among the first to study quantum phenomena in nature were Arthur Compton, C. V. Raman, and Pieter Zeeman, each of whom has a quantum effect named after him. Robert Andrews Millikan studied the photoelectric effect experimentally, and Albert Einstein developed a theory for it. At the same time, Ernest Rutherford experimentally discovered the nuclear model of the atom, for which Niels Bohr developed his theory of the atomic structure, which was later confirmed by the experiments of Henry Moseley. In 1913, Peter Debye extended Niels Bohr's theory of atomic structure, introducing elliptical orbits, a concept also introduced by Arnold Sommerfeld. This phase is known as old quantum theory.", "In 1903, Mikhail Tsvet invented chromatography, an important analytic technique. In 1904, Hantaro Nagaoka proposed an early nuclear model of the atom, where electrons orbit a dense massive nucleus. In 1905, Fritz Haber and Carl Bosch developed the Haber process for making ammonia, a milestone in industrial chemistry with deep consequences in agriculture. The Haber process, or Haber-Bosch process, combined nitrogen and hydrogen to form ammonia in industrial quantities for production of fertilizer and munitions. The food production for half the world's current population depends on this method for producing fertilizer. Haber, along with Max Born, proposed the Born\u2013Haber cycle as a method for evaluating the lattice energy of an ionic solid. Haber has also been described as the \"father of chemical warfare\" for his work developing and deploying chlorine and other poisonous gases during World War I.", "The Rutherford model is a model of the atom devised by Ernest Rutherford. Rutherford directed the famous Geiger\u2013Marsden experiment in 1909 which suggested, upon Rutherford's 1911 analysis, that J. J. Thomson's plum pudding model of the atom was incorrect. Rutherford's new model for the atom, based on the experimental results, contained new features of a relatively high central charge concentrated into a very small volume in comparison to the rest of the atom and with this central volume also containing the bulk of the atomic mass of the atom. This region would be known as the \"nucleus\" of the atom.", "In 1903, Mikhail Tsvet invented chromatography, an important analytic technique. In 1904, Hantaro Nagaoka proposed an early nuclear model of the atom, where electrons orbit a dense massive nucleus. In 1905, Fritz Haber and Carl Bosch developed the Haber process for making ammonia, a milestone in industrial chemistry with deep consequences in agriculture. The Haber process, or Haber-Bosch process, combined nitrogen and hydrogen to form ammonia in industrial quantities for production of fertilizer and munitions. The food production for half the world's current population depends on this method for producing fertilizer. Haber, along with Max Born, proposed the Born\u2013Haber cycle as a method for evaluating the lattice energy of an ionic solid. Haber has also been described as the \"father of chemical warfare\" for his work developing and deploying chlorine and other poisonous gases during World War I.", "The discovery of nuclear fission occurred in 1938 in the buildings of Kaiser Wilhelm Society for Chemistry, today part of the Free University of Berlin, following nearly five decades of work on the science of radioactivity and the elaboration of new nuclear physics that described the components of atoms. In 1911, Ernest Rutherford proposed a model of the atom in which a very small, dense and positively charged nucleus of protons (the neutron had not yet been discovered) was surrounded by orbiting, negatively charged electrons (the Rutherford model). Niels Bohr improved upon this in 1913 by reconciling the quantum behavior of electrons (the Bohr model). Work by Henri Becquerel, Marie Curie, Pierre Curie, and Rutherford further elaborated that the nucleus, though tightly bound, could undergo different forms of radioactive decay, and thereby transmute into other elements. (For example, by alpha decay: the emission of an alpha particle\u2014two protons and two neutrons bound together into a particle identical to a helium nucleus.)", "The array of problems encountered concentrated on the electrodynamics of moving bodies. Poincar\u00e9 swiftly proposed the idea that it is the ether modifying itself, and not the bodies acquiring mass, which came to contradict the older theories (based on a perfectly immovable ether). Overall, Poincar\u00e9 shed light on the Zeeman effect, caused by discontinuous emissions of electrons. The problem of discontinuous matter forced the formulation of a minimally-destabilizing model of the atom. In 1913, Niels Bohr presented his atomic model which was based on the concept of electron orbits, and which explained spectroscopy as well as the stability of the atom. But, in 1905, the problem with all attempts to define the behavior of the microscopic world was that no one then knew if they needed to consider a similar model to the one known for the macroscopic objects (the model of classical mechanics), or if they should try to develop an entirely new model to give account of new facts. The latter idea, which was followed with the quantum theory, also implied definitively abandoning the unity already found in prior theories of mechanics.", "In 1911, Ernest Rutherford gave a model of the atom in which a central core held most of the atom's mass and a positive charge which, in units of the electron's charge, was to be approximately equal to half of the atom's atomic weight, expressed in numbers of hydrogen atoms. This central charge would thus be approximately half the atomic weight (though it was almost 25% different from the atomic number of gold , ), the single element from which Rutherford made his guess). Nevertheless, in spite of Rutherford's estimation that gold had a central charge of about 100 (but was element on the periodic table), a month after Rutherford's paper appeared, Antonius van den Broek first formally suggested that the central charge and number of electrons in an atom was \"exactly\" equal to its place in the periodic table (also known as element number, atomic number, and symbolized \"Z\"). This proved eventually to be the case.", "Other important areas of research include the development of novel optical techniques for nano-optical measurements, diffractive optics, low-coherence interferometry, optical coherence tomography, and near-field microscopy. Research in optical physics places an emphasis on ultrafast optical science and technology. The applications of optical physics create advancements in communications, medicine, manufacturing, and even entertainment. One of the earliest steps towards \"atomic physics\" was the recognition that matter was composed of \"atoms\", in modern terms the basic unit of a chemical element. This theory was developed by John Dalton in the 18th century. At this stage, it wasn't clear what atoms were - although they could be described and classified by their observable properties in bulk; summarized by the developing periodic table, by John Newlands and Dmitri Mendeleyev around the mid to late 19th century.", "Models for atomic nucleus consisting of protons and neutrons were quickly developed by Werner Heisenberg and others. The proton\u2013neutron model explained the puzzle of nuclear spins. The origins of beta radiation were explained by Enrico Fermi in 1934 by the process of beta decay, in which the neutron decays to a proton by \"creating\" an electron and a (as yet undiscovered) neutrino. In 1935 Chadwick and his doctoral student Maurice Goldhaber, reported the first accurate measurement of the mass of the neutron.", "The discovery of the neutron and its properties was central to the extraordinary developments in atomic physics that occurred in the first half of the 20th century. Early in the century, Ernest Rutherford developed a crude model for the atom, based on the gold foil experiment of Hans Geiger and Ernest Marsden. In this model, atoms had their mass and positive electric charge concentrated in a very small nucleus. By 1920 chemical isotopes had been discovered, the atomic masses had been determined to be integer multiples of the mass of the hydrogen atom, and the atomic number had been identified as the charge on the nucleus. Throughout the 1920s, the nucleus was viewed as composed of combinations of protons and electrons, the two elementary particles known at the time, but that model presented several experimental and theoretical contradictions."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[730, 747], [90, 105], [55, 72], [90, 105], [315, 332], [496, 506], [9, 26], [631, 642], [87, 104], [187, 204]], "rd_topk": 5}, "test_2026": {"question": "Where is the UCLA Usc game being played", "answer": ["UCLA", "Rose Bowl", "Coliseum", "USC"], "prediction": ["California Memorial Stadium", "Rose Bowl in Pasadena, California", "Los Angeles Memorial Coliseum", "Jackie Robinson Stadium", "Pasadena, California", "Rose Bowl", "Rose Bowl", "Jackie Robinson Stadium", "Wallis Annenberg Stadium,", "Bren Events Center"], "score": [81.77222442626953, 81.70333099365234, 81.39205932617188, 81.24655151367188, 80.75079345703125, 80.74213409423828, 80.68431091308594, 80.51496887207031, 80.4332275390625, 80.42236328125], "title": [["2018 UCLA Bruins football team"], ["2017 UCLA Bruins football team"], ["2009 UCLA Bruins football team"], ["2019 UCLA Bruins baseball team"], ["2017 UCLA Bruins football team"], ["2016 UCLA Bruins football team"], ["2018 UCLA Bruins football team"], ["UCLA Bruins baseball"], ["UCLA Bruins men's soccer"], ["2018\u201319 UC Irvine Anteaters men's basketball team"]], "evidence": ["A Bruin victory at California Memorial Stadium also marked UCLA's first true road win in over two years, dating back to their 17\u201314 triumph over Brigham Young in 2016. Joshua Kelley ran for 289 yards and 2 TDs, leading the Bruins to a 34-27 victory. His 289 yards comprised the 3rd-highest single-game tally in UCLA history, and the most rushing yards by a Bruin in a game against their crosstown rival USC. After a back-and-forth game, Kelley scored a 55-yard touchdown with 10:39 remaining in the 4th quarter to give UCLA the lead, which they were able to maintain. With the win, UCLA were able to finally reclaim the rights to the coveted Victory Bell for the first time in four years.", "The 2017 UCLA Bruins football team represented the University of California, Los Angeles during the 2017 NCAA Division I FBS football season. The Bruins played its home games at the Rose Bowl in Pasadena, California. They began the season coached by sixth-year head coach Jim L. Mora. They competed as members of the South Division of the Pac-12 Conference. On November 19, one day after UCLA lost its third consecutive match-up against its crosstown rival USC, Jim Mora was fired. He finished the season 5\u20136, with a 3\u20135 record in Pac-12 play. Following Mora's dismissal, offensive coordinator Jedd Fisch was chosen to serve as interim head coach for the remainder of the season.", "The 2009 UCLA Bruins football team represented the University of California, Los Angeles (UCLA) in the 2009 NCAA Division I FBS football season. Under second-year head coach Rick Neuheisel, they opened the season at the Rose Bowl on September 5 against San Diego State. The last game of the season, against USC was moved from the \"Championship Saturday\" weekend of December. Instead, the UCLA\u2013USC rivalry game was played on Saturday, November 28 at the Los Angeles Memorial Coliseum. Following the regular season, which they finished with six wins and six losses, the Bruins were invited to play in the 2009 EagleBank Bowl, thanks to the normal tie-in Army not being bowl eligible at 5\u20137. UCLA defeated Temple 30\u201321 to finish the season with a winning record.", "The 2019 UCLA Bruins baseball team will represent the University of California, Los Angeles in the 2019 NCAA Division I baseball season as a member of the Pac-12 Conference. The team will be coached by John Savage and play their home games at Jackie Robinson Stadium. The Bruins finished 38\u201321 overall, and 19\u201311 in the conference. During the season, the Bruins were invited and participated in the Dodger Stadium Classic in Los Angeles, California. UCLA was defeated by Vanderbilt and USC. In the postseason, the Bruins were invited and participated in the 2018 NCAA Division I Baseball Tournament, where they lost to Minnesota twice in the Corvallis Regional in Corvallis, Oregon. The Bruins had four individuals selected in the 2018 MLB draft.", "The 2017 UCLA Bruins football team represented the University of California, Los Angeles during the 2017 NCAA Division I FBS football season. The Bruins played its home games at the Rose Bowl in Pasadena, California. They began the season coached by sixth-year head coach Jim L. Mora. They competed as members of the South Division of the Pac-12 Conference. On November 19, one day after UCLA lost its third consecutive match-up against its crosstown rival USC, Jim Mora was fired. He finished the season 5\u20136, with a 3\u20135 record in Pac-12 play. Following Mora's dismissal, offensive coordinator Jedd Fisch was chosen to serve as interim head coach for the remainder of the season.", "The 2016 UCLA Bruins football team represented the University of California, Los Angeles in the 2016 NCAA Division I FBS football season. The Bruins were coached by fifth-year head coach Jim L. Mora and played its home games at the Rose Bowl in Pasadena, California. They were members of the South Division of the Pac-12 Conference. They finished the season 4\u20138, 2\u20137 in Pac-12 play to finish in a tie for fourth in the South Division. Calling the game on CBS: Verne Lundquist, Gary Danielson and Allie LaForce. Pac-12 Networks: Ted Robinson, Yogi Roth and Cindy Brunson.", "The 2018 UCLA Bruins football team represented the University of California, Los Angeles in the 2018 NCAA Division I FBS football season. The Bruins were led by first-year head coach Chip Kelly and played their home games at the Rose Bowl. UCLA was a member of the Pac-12 Conference in the South Division. They began the season 0\u20134 for the first time since 1971, as well as 0\u20135 for the first time since 1943, before finally winning their first game, in dominating fashion, against Cal. However, despite failing to improve upon their previous season's output of 6 wins and 7 losses and failing to qualify for a bowl game, the Bruins later defeated the USC Trojans to end a three-game losing streak in their crosstown rivalry. The Bruins finished 3\u20139 overall, their worst record since 1971. They went 3\u20136 in Pac-12 play, finishing in fifth place in the South Division.", "The UCLA Bruins baseball team is the varsity college baseball team of the University of California, Los Angeles. Having started playing in 1920, the program is a member of the NCAA Division I Pac-12 Conference. It plays its home games at Jackie Robinson Stadium. The program has appeared in five College World Series and won the 2013 National Championship. Chris Chambliss and Steve Edney led the Bruins to the 1969 CWS, UCLA's first. The team defeated Santa Clara at the NCAA Regional and finished in 7th place, after losing to Tulsa, 6\u20135 in 10 innings, and to Arizona State, 2\u20131 in 12 innings. Chambliss, who went on to play for Major League Baseball's Cleveland Indians, New York Yankees, and Atlanta Braves between 1971 and 1986, had a team-high .340 batting average and 15 home runs. Other members of the team included Bill Bonham, Steven Edney, Mike Reinbach, and Jim York.", "The UCLA Bruins men's soccer team is an intercollegiate varsity sports team of the University of California at Los Angeles. The team is a member of the Pac-12 Conference of the National Collegiate Athletic Association. From 1969 until 2017 the Bruins played at Frank Marshall Field of Drake Stadium on campus. The stadium is named in honor of Elvin C. \"Ducky\" Drake, UCLA's long time trainer and former student athlete. Film producer Marshall graduated from UCLA. In 2018, the program moved into the soccer-specific stadium, Wallis Annenberg Stadium, along with the UCLA Bruins women's soccer program. \"This list of former players includes those who received international caps, made significant contributions to the team in terms of appearances or goals, or who made significant contributions to the sport after they left. It is clearly not yet complete and all inclusive, and additions and refinements will continue to be made over time.\" The UCLA Bruins have an NCAA Division I Tournament record of 74\u201340 through forty-four appearances.", "The 2018\u201319 UC Irvine Anteaters men's basketball team represents the University of California, Irvine in the 2018\u201319 NCAA Division I men's basketball season. The Anteaters are led by ninth-year head coach Russell Turner and competes in the Bren Events Center. UC Irvine is a member of the Big West Conference, and participates in their 41st consecutive season in that league. The Anteaters finished the season 18\u201317 overall, and 11\u20135 in the conference. During the season, the Anteaters participated in the Las Vegas Invitational, which was held in Manhattan, Kansas, Tempe, Arizona, and Paradise, Nevada. UC Irvine finished 7th place by defeating Northern Arizona and losing to Rider. Prior to the tournament, UC Irvine lost at Kansas State and at Arizona State as friendly matches. UC Irvine also defeated Idaho in the Vandal Holiday Hoops Classic in Boise, Idaho. In the postseason, UC Irvine defeated Hawaii and UC Santa Barbara but lost to Cal State Fullerton in the championship of the 2018 Big West Conference Men's Basketball Tournament in Anaheim, California."], "em_top1": false, "em_top10": true, "f1_top1": 0, "f1_top10": 1.0, "se_pos": [[19, 46], [182, 215], [453, 482], [243, 266], [195, 215], [232, 241], [229, 238], [238, 261], [525, 550], [240, 258]], "rd_topk": 1}, "test_2027": {"question": "When was the electronic funds transfer act signed into law", "answer": ["November 10 , 1978", "in 1978", "1978"], "prediction": ["1978", "in 1978", "1978", "1978", "1978 and signed by President Jimmy Carter", "President Jimmy Carter", "1978", "January 1, 2011", "September 29, 2006", "Regulation E"], "score": [83.22341918945312, 82.56487274169922, 81.58412170410156, 80.81773376464844, 80.37208557128906, 79.77494812011719, 78.03546142578125, 76.75361633300781, 76.42762756347656, 76.2978515625], "title": [["Electronic Fund Transfer Act"], ["Electronic Fund Transfer Act"], ["Bank regulation in the United States"], ["Electronic funds transfer"], ["Electronic Fund Transfer Act"], ["Electronic Fund Transfer Act"], ["Financial privacy laws in the United States"], ["Tax withholding in the United States"], ["Credit Rating Agency Reform Act"], ["Unfair or Deceptive Acts or Practices"]], "evidence": ["The Electronic Fund Transfer Act was passed by the U.S. Congress in 1978 and signed by President Jimmy Carter, to establish the rights and liabilities of consumers as well as the responsibilities of all participants in electronic funds transfer activities. The act was implemented in Federal Reserve Board Regulation E. The EFT Act recognizes their right to nominate the financial institution to which such payments are to be made. The EFT Act also prohibits a creditor or lender from requiring a consumer to repay a loan or other credit by electronic fund transfer, except when there is an overdraft on checking plans.", "The Electronic Fund Transfer Act was passed by the U.S. Congress in 1978 and signed by President Jimmy Carter, to establish the rights and liabilities of consumers as well as the responsibilities of all participants in electronic funds transfer activities. The act was implemented in Federal Reserve Board Regulation E. The EFT Act recognizes their right to nominate the financial institution to which such payments are to be made. The EFT Act also prohibits a creditor or lender from requiring a consumer to repay a loan or other credit by electronic fund transfer, except when there is an overdraft on checking plans.", "The \"Electronic Fund Transfer Act\" of 1978, implemented by \"Regulation E\", established the rights and liabilities of consumers as well as the responsibilities of all participants in electronic funds transfer activities. Until 2011, \"Regulation Q\" prohibited banks from paying interest on demand deposit accounts. A \"demand deposit\" account includes many, but not all checking accounts, and does not include Negotiable Order of Withdrawal accounts (NOW accounts). The \"Home Mortgage Disclosure Act\" (HMDA) of 1975, implemented by \"Regulation C\", requires financial institutions to maintain and annually disclose data about home purchases, home purchase pre-approvals, home improvement, and refinance applications involving one- to four-unit and multifamily dwellings. It also requires branches and loan centers to display a HMDA poster.", "Electronic funds transfer (EFT) are electronic transfer of money from one bank account to another, either within a single financial institution or across multiple institutions, via computer-based systems, without the direct intervention of bank staff. According to the United States Electronic Fund Transfer Act of 1978 it is \"a funds transfer initiated through an electronic terminal, telephone, computer (including on-line banking) or magnetic tape for the purpose of ordering, instructing, or authorizing a financial institution to debit or credit a consumer\u2019s account. \" EFT transactions are known by a number of names across countries and different payment systems. For example, in the United States, they may be referred to as \"electronic checks\" or \"e-checks\". In the United Kingdom, the term \"bank transfer\" and \"bank payment\" are used, while in several other European countries \"giro transfer\" is the common term. EFTs include, but are not limited to:", "The Electronic Fund Transfer Act was passed by the U.S. Congress in 1978 and signed by President Jimmy Carter, to establish the rights and liabilities of consumers as well as the responsibilities of all participants in electronic funds transfer activities. The act was implemented in Federal Reserve Board Regulation E. The EFT Act recognizes their right to nominate the financial institution to which such payments are to be made. The EFT Act also prohibits a creditor or lender from requiring a consumer to repay a loan or other credit by electronic fund transfer, except when there is an overdraft on checking plans.", "The Electronic Fund Transfer Act was passed by the U.S. Congress in 1978 and signed by President Jimmy Carter, to establish the rights and liabilities of consumers as well as the responsibilities of all participants in electronic funds transfer activities. The act was implemented in Federal Reserve Board Regulation E. The EFT Act recognizes their right to nominate the financial institution to which such payments are to be made. The EFT Act also prohibits a creditor or lender from requiring a consumer to repay a loan or other credit by electronic fund transfer, except when there is an overdraft on checking plans.", "The Electronic Funds Transfer Act was passed by congress in 1978 to regulate the then growing use of electronic transfer of funds. The act implemented requirements so that banks have to notify their customers of any policies regarding electronic transfer of funds. A model statement is even included in the act in order to regulate the language in which policies would be presented to consumers. Banks are also held liable in the event that information is disclosed through telephone without consent. Also, banks would be held responsible for any damages that came as a result of unauthorized access to a consumer's information.", "Payers of interest, dividends, and certain other items must withhold 28% Federal income tax on such payments in limited circumstances. Generally, this applies only if the recipient is a U.S. person, and either Withheld taxes must be paid to the appropriate government promptly. Rules vary by jurisdiction and by balance of total payments due. Federal employment tax payments are due either monthly or semi-weekly. Federal tax payments must be made either by deposit to a national bank or by electronic funds transfer. If the balance of Federal tax payments exceeds $100,000, it must be paid within 1 banking day. Beginning January 1, 2011, payments may be made only by electronic funds transfer. State rules vary widely, and generally allow slightly more time for deposit of withheld taxes.", "The Credit Rating Agency Reform Act is a United States federal law whose goal is to improve ratings quality for the protection of investors and in the public interest by fostering accountability, transparency, and competition in the credit rating agency industry. Enacted after being signed by President Bush on September 29, 2006, it amended the Securities Exchange Act of 1934 to require nationally recognized statistical rating organizations (NRSROs) to register with the Securities and Exchange Commission (SEC).", "The proposal would also address subprime credit cards by limiting the fees that reduce the available credit. In addition, banks that make firm offers of credit advertising multiple rates or credit limits would be required to disclose in the solicitation the factors that determine whether a consumer will qualify for the lowest rate and highest credit limit. The proposal has been placed in the Federal Register. This 2008 regulatory proposal under Regulation AA was not finalized and was ultimately withdrawn. It was replaced by final regulations that the Federal Reserve Board issued to regulate practices under Regulation Z (Truth in Lending Act) for credit card practices and Regulation E (Electronic Fund Transfer Act) for deposit account overdrafts stemming from debit card and ATM card transactions. The Congress also addressed these practices in the Credit CARD Act of 2009, which was also implemented by the Federal Reserve under Regulation Z."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[68, 72], [65, 72], [38, 42], [315, 319], [68, 109], [87, 109], [60, 64], [623, 638], [312, 330], [680, 692]], "rd_topk": 4}, "test_2028": {"question": "When did the first Pokemon game come out", "answer": ["October 2000", "1996"], "prediction": ["October 1996", "1996", "1996", "December 18, 1998", "December 18, 1998", "27 February 1996", "February 1996", "1998", "July 2015", "1996"], "score": [90.8474349975586, 90.27640533447266, 90.18621826171875, 89.03923034667969, 88.07748413085938, 88.01620483398438, 87.66896057128906, 86.87933349609375, 86.62168884277344, 86.60337829589844], "title": [["Poke\u0301mon Trading Card Game"], ["Poke\u0301mon (video game series)"], ["Gameplay of Poke\u0301mon"], ["Poke\u0301mon Trading Card Game (video game)"], ["Poke\u0301mon Trading Card Game (video game)"], ["List of Poke\u0301mon"], ["Poke\u0301mon"], ["List of Poke\u0301mon films"], ["Pokke\u0301n Tournament"], ["List of Poke\u0301mon Trading Card Game sets"]], "evidence": ["The , abbreviated to PTCG or Pok\u00e9mon TCG, is a collectible card game, based on Nintendo's Pok\u00e9mon franchise of video games and anime, first published in October 1996 by Media Factory in Japan. In the US, it was initially published by Wizards of the Coast; The Pok\u00e9mon Company eventually took over publishing the card game in June 2003. In 2016, it was the year's top-selling toy in the strategic card game subclass. In 2017, it had an 82% share of Europe's strategic card game market. As of March 2018, the game has sold over 25.7billion cards worldwide.", "Pok\u00e9mon is a series of video games developed by Game Freak and published by Nintendo as part of the \"Pok\u00e9mon\" media franchise. First released in 1996 in Japan for the Game Boy, the main series of role-playing video games (RPGs), also referred as the \"core series\" by their developers, has continued on each generation of Nintendo's handhelds. The games are commonly released in pairs, each with slight variations, with a remake of the games usually released a few years after the original versions for another console. While the main series consists of RPGs, a big number of spin-off games based on the series have been developed by various companies, encompassing other genres such as action role-playing, puzzle, fighting, and digital pet games.", "Each of the games in the handheld \"Pok\u00e9mon\" RPG series, from the first games in 1996 to the latest ones in 2017, takes place in a particular fictional region of the Pok\u00e9mon world, and begins with the player receiving a Starter Pok\u00e9mon from that region's Pok\u00e9mon Professor. By traveling around the world, catching and evolving Pok\u00e9mon, and defeating other Trainers in battle, the player increases the size and strength of his or her Pok\u00e9mon collection. A major subplot of each game is to defeat a criminal organization trying to take over the world through the misuse of Pok\u00e9mon. These organizations include Team Rocket, Team Magma and Team Aqua, Team Galactic, Team Plasma, Team Flare, and Team Skull/Aether Foundation.", "Pok\u00e9mon Trading Card Game, originally released in Japan as is a video game adaptation of the original tabletop trading card game of the same name, which in turn was based on the \"Pok\u00e9mon\" role-playing video game series. Developed by Hudson Soft and Creatures, and published by Nintendo, it was initially released in Japan on December 18, 1998, with an English version appearing in North America in April 10, 2000 and in Europe the following December. The title features digital versions of cards from the first three sets of the trading card game originally released in English by Wizards of the Coast between 1998 and 1999, as well as exclusive cards not available outside of the game.", "The game was released in Japan on December 18, 1998 under the title one month before the tabletop version debuted in English. In September 1999, Nintendo of America announced that they would be releasing an English version in North America with the proposed title of simply \"Pok\u00e9mon Card\". Though initially planned for release the following winter, the game, now known under its finalized title of \"Pok\u00e9mon Trading Card Game\", was pushed back to April 2000, which IGN attributed to the company wanting to focus their efforts on the upcoming \"Pok\u00e9mon Stadium\" for the Nintendo 64. The following February, the game made an appearance at the 2000 Toy Fair in New York City as part of Nintendo's \"Pok\u00e9mon 2000\" interactive line-up along with \"Pok\u00e9mon Gold\" and \"Silver\". An exclusive tabletop version promotional card from Wizards of the Coast featuring Meowth was included with the game.", "The premise of \"Pok\u00e9mon\" in general was conceived by Satoshi Tajiri\u2014who later founded Game Freak\u2014in 1989, when the Game Boy was released. The creatures that inhabit the world of \"Pok\u00e9mon\" are also called Pok\u00e9mon. The word \"Pok\u00e9mon\" is a romanized contraction of the Japanese brand . The concept of the Pok\u00e9mon universe, in both the video games and the general fictional world of Pok\u00e9mon, stems most notably from Tajiri's childhood hobby of insect collecting. Other influences on the concept include Ultraman, anime, and playing video games in general. Throughout his early life, Tajiri saw his rural, nature-filled hometown (Machida, Tokyo) transform into an urban center. The urbanization of his town drove away wildlife and he and others living in the area were eventually unable to collect insects. Through Pok\u00e9mon, Tajiri sought to bring back this outdoor pastime and share it with the world. The first games in the franchise, \"Red\" and Green\", were released on 27 February 1996 in Japan for the Game Boy; the games saw an international release as \"Red\" and \"Blue\" in September 1998. The ability to capture, battle, trade, and care for numerous creatures catapulted Pok\u00e9mon to international popularity and it has become a multibillion-dollar franchise and the second-best selling video game series, only behind the \"Mario\" franchise.", "The franchise began as \"Pok\u00e9mon Red\" and \"Green\" (released outside of Japan as \"Pok\u00e9mon Red\" and \"Blue\"), a pair of video games for the original Game Boy that were developed by Game Freak and published by Nintendo in February 1996. \"Pok\u00e9mon\" has since gone on to become the highest-grossing media franchise of all time, with over in revenue up until March 2017. The original video game series is the second best-selling video game franchise (behind Nintendo's \"Mario\" franchise) with more than 300million copies sold and over 800million mobile downloads. In addition, the \"Pok\u00e9mon\" franchise includes the world's top-selling toy brand, the top-selling trading card game with over 25.7billion cards sold, an anime television series that has become the most successful video game adaptation with over 20 seasons and 1,000 episodes in 124 countries, as well as an anime film series, a , books, manga comics, music, and merchandise. The franchise is also represented in other Nintendo media, such as the \"Super Smash Bros.\" series.", "\"Pok\u00e9mon\" is a media franchise created by video game designer Satoshi Tajiri that centers on creatures called Pok\u00e9mon. 21 animated films based on the franchise and creatures were produced by the animation studios OLM and Wit Studio, directed by Kunihiko Yuyama and Tetsuo Yajima, and distributed in Japan by Toho, with various studios distributing the films in North America. The first \"Pok\u00e9mon\" animated film, \"\", was released in Japan in 1998. A live-action film, \"\", was produced by American studio Legendary Entertainment, directed by Rob Letterman, and will be distributed in Japan by Toho, and outside of Japan and China by Warner Bros. It is scheduled for release on May 10, 2019. The latest animated movie, titled \"Pok\u00e9mon the Movie: Mewtwo Strikes Back Evolution\", will be released in Japan on July 12, 2019.", "Pokk\u00e9n Tournament is a fighting game developed by Bandai Namco Studios and published by Nintendo and The Pok\u00e9mon Company.. The game combines gameplay elements from Bandai Namco's \"Tekken\" series with characters from Nintendo's \"Pok\u00e9mon\" franchise. It was released for Japanese arcades in July 2015, and worldwide for the Wii U in March 2016. An enhanced port for the Nintendo Switch, titled Pokk\u00e9n Tournament DX, was released in September 2017. \"Pokk\u00e9n Tournament\" is a fighting game in which two fighters battle against each other using various Pok\u00e9mon, with gameplay shifting between \"Field Phase\" where the Pok\u00e9mon move freely around the arena similar to Power Stone and , and \"Duel Phase\" where they move relative to each other similar to the \"Tekken\" games. Unlike most arcade fighting games, which use a traditional joystick and buttons, the arcade version is played using console-style controllers, which are designed so that players who are not used to arcade sticks can get into the game more easily. The game focuses more on action, as opposed to the more technical gameplay of \"Tekken\", allowing both hardcore and casual fans to enjoy it. As such, players can perform various techniques taken from the \"Pok\u00e9mon\" series, such as special moves and Mega Evolutions (which can be built up from attacks using a \"Synergy Gauge\"). Players can also use Support Pok\u00e9mon to give them special benefits such as buffs in attack or defense. First-print Wii U copies of the game were packaged with a Shadow Mewtwo Amiibo card, which immediately unlocked the character for use. The title also features online play, where players can compete in two types of online battle modes called friendly battles and ranked battles, including matches between players with registered friend codes and players who enter the same VS Code as each other.", "This is a list of Pok\u00e9mon Trading Card Game sets which is a collectible card game first released in Japan in 1996. As of September 2017, there are 74 card sets released in America and 68 in Japan. Collectively, there are 6,959 cards in the Japanese sets and 9,110 cards in the English sets. The large difference stems from non-holofoil duplicates of rare cards included in English sets that are not printed in Japanese sets. As of March 2017, 23.6 billion cards were shipped worldwide. The sets are generally broken into two lists; One for the first line of Wizards of the Coast cards, and the second after Nintendo's acquisition of the card game after Wizards."], "em_top1": false, "em_top10": true, "f1_top1": 0.6666666666666666, "f1_top10": 1.0, "se_pos": [[153, 165], [145, 149], [80, 84], [325, 342], [34, 51], [966, 982], [217, 230], [440, 444], [288, 297], [109, 113]], "rd_topk": 1}, "test_2029": {"question": "Who does the voice of Salem the cat", "answer": ["Nicholas `` Nick '' Bakay"], "prediction": ["Nicholas Bakay", "Nick Bakay),", "Ian James Corlett", "Bakay", "Nick Bakay,", "Robert Smigel", "Nick Bakay)", "Seth Gabel", "Ronnie Scribner", "Nick Bakay"], "score": [86.713623046875, 83.49777221679688, 82.8299560546875, 82.76161193847656, 82.34323120117188, 82.24208068847656, 82.18974304199219, 82.04791259765625, 82.02031707763672, 81.88949584960938], "title": [["Nick Bakay"], ["Sabrina the Teenage Witch (1996 TV series)"], ["Salem Saberhagen"], ["Nick Bakay"], ["Sabrina: The Animated Series"], ["Robert Smigel"], ["List of Sabrina the Teenage Witch characters"], ["Seth Gabel"], ["Ronnie Scribner"], ["Salem Saberhagen"]], "evidence": ["Nicholas Bakay ( ; born October 8, 1959) is an American actor, voice actor, writer, comedian and sportscaster. He is known as the voice of Salem Saberhagen on ABC/The WB's \"Sabrina the Teenage Witch\" and \"\", and Norbert Beaver on \"The Angry Beavers\". He played Karl on the Fox series \"'Til Death\" as well as serving as a producer of the show until it was cancelled by Fox. Nicholas Bakay was born on October 8, 1959 in Buffalo, New York, where he attended Nichols School. He graduated from Kenyon College in 1981. He has Hungarian roots (his surname means \"from Baka\").", "Sabrina the Teenage Witch is an American sitcom based on the Archie Comics series of the same name. The show premiered on September 27, 1996, on ABC to over 17 million viewers in its \"T.G.I.F.\" line-up. The show stars Melissa Joan Hart as Sabrina Spellman, an American teenager who, on her sixteenth birthday, discovers she has magical powers (a departure from the \"Archie Comics\", where she has known of her magic powers since an early age as revealed in the \"Sabrina \u2013 That Cute Little Witch\" storylines in many \"Little Archie\" comic books). She lives with her 500-year-old aunts, witches Hilda (played by Caroline Rhea) and Zelda (played by Beth Broderick), and their magical talking cat, Salem (voiced by Nick Bakay), at 133 Collins Road, in the fictional Boston suburb of Westbridge, Massachusetts through most of the series.", "Salem appeared in the \"Sabrina the Teenage Witch\" live-action TV movie. Salem appeared in the 2013 series \"\". Ian James Corlett voices Salem. His voice in the 2013 series was an imitation of actor Paul Lynde. Unlike in previous incarnations, he's a spy for Enchantra the head witch, and the Spellman family isn't aware he's really a witch. Currently, Salem appears in the Netflix television series, which is based on an adaptation of the \"Chilling Adventures of Sabrina\" comics. Instead of being a human originally like in previous iterations of the character, Salem is a familiar, which are goblins who have taken on the shape of animals to better serve their witch masters. This version of the character also doesn't speak though it was hinted that he might in the future by series creator Roberto Aguirre-Sacasa. Although, he currently only communicates via telepathy, represented in the form of a meow.", "Bakay served as a writer of \"Sabrina the Teenage Witch\", in which he also voiced Salem Saberhagen, a warlock who has been transformed into the Spellman family's pet cat for trying to take over the world. Bakay also served as a writer for \"\", also providing his voice as Salem as well. He was also the voice of Norbert on \"The Angry Beavers\". Bakay is also an avid sport writer and commentator. He writes a weekly column for NFL.com called \"Nick Bakay's Manly House of Football\", as well as occasional columns for ESPN.com and \"ESPN The Magazine\". He appears on \"SportsCenter\" on ESPN Wednesday and Thursday mornings during NFL season, and has frequently done segments on \"NFL Total Access\" on NFL Network. Bakay also has guest hosted numerous episodes of \"Up Close\" and \"Talk2\", as well as contributed to \"Jim Rome Is Burning\" and numerous other sports shows.", "Melissa Joan Hart, who starred as Sabrina in the live-action sitcom, acted as producer of this series, but her younger sister Emily Hart (who played the recurring character Amanda on the sitcom) voiced Sabrina. Melissa instead voiced Sabrina's two aunts, Hilda and Zelda, originally played by Beth Broderick and Caroline Rhea. Salem is voiced by Nick Bakay, who also voiced Salem in both the film and live-action series. The theme song is sung by B*Witched. The series first ran in syndication on UPN (on \"Disney's One Too\" weekday afternoon block) and ABC (on \"Disney's One Saturday Morning\" block) for one season, with 65 episodes produced.", "Robert Smigel (born February 7, 1960) is an American actor, humorist, puppeteer, comedian and writer known for his \"Saturday Night Live\" \"TV Funhouse\" cartoon shorts and as the puppeteer and voice behind Triumph the Insult Comic Dog. He also co-wrote the \"Hotel Transylvania\" films and \"You Don't Mess with the Zohan\", both starring Adam Sandler. Smigel was born in New York City, to Lucia and Irwin Smigel, an aesthetic dentist, innovator and philanthropist. He is Jewish and frequently went to Jewish summer camp. He attended Cornell University, studying pre-dental, and graduated from New York University in 1983 with a degree in political science.", "Salem Saberhagen (voiced by Nick Bakay) is a 500-year-old warlock who was a criminal of the Other Realm and was sentenced to spend 100 years as a cat as punishment for attempting to take over the world. He was sent to live with Hilda who was punished with keeping Salem worm-free. Despite his megalomaniacal desires for world domination (which he attempts periodically throughout the series), he is generally portrayed as having a good heart and being a loyal friend to Sabrina. In the series he would generally serve two roles: one as a mentor for Sabrina, as she found it easier to go to him with her messier problems, or the trouble-maker, such as finding another illicit way to become human without being punished or convincing Sabrina to use magic to solve her problems, both of which generally ended up putting Sabrina in even more trouble. When Sabrina's aunts left for the Other Realm, Salem stayed with Sabrina, and continued his attempts to become human. Salem became good pals with Harvey after he returned to the series, and would generally attempt to abuse this friendship to get some more power to take over the world. Salem also went on vacations with Sabrina in the made-for-television movies.", "Seth Gabel (born October 3, 1981) is an American actor. Gabel is known for his roles of agent Lincoln Lee on Fox's television series \"Fringe\", and Cotton Mather on WGN America's series \"Salem\". He is a great-nephew of actor Martin Gabel. Gabel was born to a Jewish family in Hollywood, Florida. He was raised under the surname of his stepfather, who adopted him, \"Cosentino\". He graduated from University School of Nova Southeastern University in Davie, Florida in 1999, and from New York University's Tisch School of the Arts.", "Ronnie Scribner (born July 23, 1966) is an American former actor. Beginning his career as a professional child actor and model at the age of 11, Scribner is perhaps best known for his role as the child vampire Ralphie Glick in the 1979 CBS mini-series \"Salem's Lot\". Rising to prominence among teenage audiences as an adolescent, he is also known for his multiple guest-starring roles throughout the late 1970s and early 1980s on such television series as the \"ABC Afterschool Special\", \"Little House on the Prairie\", \"The Love Boat\", \"Fantasy Island\", \"CHiPs\", and \"Dallas\", among others.", "In a few instances where his human form is shown in flashbacks, he is portrayed with his face in shadows, but with a body type and militaristic uniform similar to Fidel Castro (Castro himself is depicted as being a friend of Salem). In the sitcom and \"Sabrina: The Animated Series\", Salem was voiced by actor Nick Bakay In one sitcom episode titled \"Jealousy\", Salem says he needs to make a phone call to Bakay, saying, \"I need to call in to Nick Bakay's sports show on ESPN radio. All he ever talks about is the Buffalo Bills, and his voice? LORD, is it annoying!\""], "em_top1": false, "em_top10": false, "f1_top1": 0.8, "f1_top10": 0.8, "se_pos": [[0, 14], [709, 721], [110, 127], [0, 5], [346, 357], [0, 13], [28, 39], [0, 10], [0, 15], [309, 319]], "rd_topk": 1}, "test_2030": {"question": "What is an example of an Americanized Mexican food created by Tex-Mex cuisine", "answer": ["fajitas", "chili con carne", "hard tacos", "nachos"], "prediction": ["Chili con carne", "Chili con carne and chimichangas", "Chili", "chimichangas", "chili con carne", "Tex-Mex", "Tex-Mex", "Tex-Mex cuisine.", "Tex-Mex", "guacamole,"], "score": [92.90233612060547, 92.49102783203125, 91.43919372558594, 89.81689453125, 89.15141296386719, 89.09324645996094, 89.03750610351562, 88.09042358398438, 87.68115234375, 87.22393035888672], "title": [["Mexican cuisine"], ["Mexican cuisine"], ["Mexican cuisine"], ["Mexican cuisine"], ["Tex-Mex"], ["Cuisine of the Southern United States"], ["Fusion cuisine"], ["Hispanic America"], ["Culture of the United States"], ["Texan cuisine"]], "evidence": ["Mexican food in the United States is based on the food of northern Mexico. Chili con carne and chimichangas are examples of American food with Mexican-origins known as Tex-Mex. With the growing ethnic Mexican population in the United States, more authentic Mexican food is gradually appearing in the United States. One reason is that Mexican immigrants use food as a means of combating homesickness, and for their descendants, it is a symbol of ethnicity. Alternatively, with more Americans experiencing Mexican food in Mexico, there is a growing demand for more authentic flavors.", "Mexican food in the United States is based on the food of northern Mexico. Chili con carne and chimichangas are examples of American food with Mexican-origins known as Tex-Mex. With the growing ethnic Mexican population in the United States, more authentic Mexican food is gradually appearing in the United States. One reason is that Mexican immigrants use food as a means of combating homesickness, and for their descendants, it is a symbol of ethnicity. Alternatively, with more Americans experiencing Mexican food in Mexico, there is a growing demand for more authentic flavors.", "Mexican food in the United States is based on the food of northern Mexico. Chili con carne and chimichangas are examples of American food with Mexican-origins known as Tex-Mex. With the growing ethnic Mexican population in the United States, more authentic Mexican food is gradually appearing in the United States. One reason is that Mexican immigrants use food as a means of combating homesickness, and for their descendants, it is a symbol of ethnicity. Alternatively, with more Americans experiencing Mexican food in Mexico, there is a growing demand for more authentic flavors.", "Mexican food in the United States is based on the food of northern Mexico. Chili con carne and chimichangas are examples of American food with Mexican-origins known as Tex-Mex. With the growing ethnic Mexican population in the United States, more authentic Mexican food is gradually appearing in the United States. One reason is that Mexican immigrants use food as a means of combating homesickness, and for their descendants, it is a symbol of ethnicity. Alternatively, with more Americans experiencing Mexican food in Mexico, there is a growing demand for more authentic flavors.", "Some ingredients are common in Mexican cuisine, but other ingredients not typically used in Mexico are often added. Tex-Mex cuisine is characterized by its heavy use of shredded cheese, meat (particularly beef, pork and chicken), beans, peppers and spices, in addition to flour tortillas. Dishes such as Texas-style chili con carne, nachos, cripsy tacos, and fajitas, are all Tex-Mex inventions. Generally cheese plays a much bigger role in Tex-Mex food than in mainstream Mexican cuisine, particularly in the popularity of Chile con queso (often referred to as simply \"queso\") which is often eaten with chips (alongside or in place of guacamole and salsa), or may be served over enchiladas, tamales or burritos.", "The South's fondness for a full breakfast derives from the British full breakfast or fry-up. Many Southern foodways, especially in Appalachia, are Scottish or Border meals adapted to the new subtropical climate; pork, once considered informally taboo in Scotland, takes the place of lamb and mutton, and instead of chopped oats, Southerners eat grits, although oatmeal is much more common now than it once was. Parts of the South have other cuisines, though. Creole cuisine is mostly vernacular French, West African and Spanish; Floribbean cuisine is Spanish-based with obvious Caribbean influences; and Tex-Mex has considerable Mexican and Native American influences.", "Fusion cuisine is cuisine that combines elements of different culinary traditions. Cuisines of this type are not categorized according to any one particular cuisine style and have played a part in innovations of many contemporary restaurant cuisines since the 1970s. Fusion food is a general term for the combination of various forms of cookery and comes in several forms. Regional fusion combines different cuisines of a region or sub-region. Asian fusion restaurants, which combine the various cuisines of different Asian countries, have become popular in many parts of the United States and United Kingdom. Often featured are East Asian, South-East Asian, and South Asian dishes alongside one another and offering dishes that are inspired combinations of such cuisines. California cuisine is considered a fusion culture, taking inspiration particularly from Italy, France, Mexico, the idea of the European delicatessen, and eastern Asia, and then creating traditional dishes from these cultures with non-traditional ingredients - such as California pizza. Other examples of this style include Tex-Mex, which combines Southwestern United States cuisine and Mexican cuisines, and Pacific rim cuisine, which combines the different cuisines of the various island nations. In the United Kingdom, Fish and Chips can be seen as an early fusion dish due to its marrying of ingredients stemming from Jewish, French, and Belgian cuisines. Filipino cuisine is also sometimes characterized as the \"original Asian fusion cuisine\", combining native culinary traditions and ingredients with the very different cuisines of Spain, Latin America, China, and the United States, among others, due to its unique colonial history.", "Hispanic cuisine as the term is applied in the Western Hemisphere, is a misnomer. What is usually considered Hispanic cuisine in the United States is mostly Mexican and Central American cuisine. Mexican cuisine is composed of mainly indigenous\u2014Aztec and Mayan\u2014and Spanish influences. Mexican cuisine is considered intangible cultural heritage by UNESCO and can be found all over the United States. In the United States, with its growing Hispanic population, food staples from Mexican cuisine and the cuisine from other Hispanic countries have become widely available. Over the years, the blending of these cuisines has produced unique American forms such as Tex-Mex cuisine. This cuisine, which originated in Texas, is based on maize products, heavily spiced ground beef, cheese and tomato sauces with chilies. This cuisine is widely available not just in the United States but across other countries, where American exports are found. In Florida, Cuban food is widely available. All of these Hispanic foods in the United States have evolved in character as they have been commercially americanized by large restaurant chains and food companies.", "The types of food served at home vary greatly and depend upon the region of the country and the family's own cultural heritage. Recent immigrants tend to eat food similar to that of their country of origin, and Americanized versions of these cultural foods, such as American Chinese cuisine, Tex-Mex (Mexican-American cuisine) or Italian-American cuisine often eventually appear; an example is Vietnamese cuisine, Korean cuisine and Thai cuisine. German cuisine has a profound impact on American cuisine, especially mid-western cuisine; potatoes, noodles, roasts, stews, cakes, and other pastries are the most iconic ingredients in both cuisines. Dishes such as the hamburger, pot roast, baked ham, and hot dogs are examples of American dishes derived from German cuisine.", "Texan cuisine is the food associated with the U.S. state of Texas. Texas is a large state, and its cuisine has been influenced by a wide range of cultures, including Southern, German, British, African American, Cajun/Creole, Mexican, Native American, Asian, and to a lesser degree, Jewish and Italian. Tex-Mex refers to a style of cooking that combines traditional Norte\u00f1o (northern) Mexican cuisine adapted to the tastes and kitchen techniques of Texans of Anglo- and European origins. Tex-Mex cooking differs from traditional Mexican cooking by using different proportions or types of ingredients, such as meats (like ground beef), melted cheeses, and spices more suited to palates less disposed to piquant flavorings. Tex-Mex cuisine has influenced what is often called \"Mexican\" cuisine in many parts of the U.S. and Europe. Dishes associated with Tex-Mex cooking include guacamole, chile con queso, tostadas with red salsa, tortilla soup, nachos, tacos, enchiladas, fajitas, quesadillas, chimichangas, burritos, tamales, and carne guisada. Breakfast items include scrambled egg in flour tortilla tacos as migas and huevos con chorizo, huevos rancheros, and empanadas of various meats. Entrees are commonly accompanied by pan fried potato and refried beans. Deserts include flan, tres leches cake, fruit sherbets, and pralines."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[75, 90], [75, 107], [75, 80], [95, 107], [316, 331], [604, 611], [1096, 1103], [658, 674], [292, 299], [876, 886]], "rd_topk": 2}, "test_2031": {"question": "Who played Joey'S agent Estelle on friends", "answer": ["June Gable"], "prediction": ["June Gable", "June Gable", "Lyndsy Fonseca)", "Marcos de la Cruz", "Gable", "Natalia Cordova-Buckley", "Sophia Capasso),", "Kaylee Anne DeFer", "Natalia Cordova-Buckley", "Sicily Sewell"], "score": [90.19282531738281, 88.06459045410156, 84.5821533203125, 83.93008422851562, 83.80670166015625, 83.10169982910156, 82.89923095703125, 82.83811950683594, 82.484375, 81.96063232421875], "title": [["List of Friends characters"], ["June Gable"], ["List of Agent Carter characters"], ["List of Sons of Anarchy characters"], ["June Gable"], ["Agents of S.H.I.E.L.D. (season 5)"], ["Tiffany Butcher"], ["Kaylee DeFer"], ["Natalia Cordova-Buckley"], ["Sicily (actress)"]], "evidence": ["Estelle Leonard (June Gable): Joey's talent agent. Gable made her first appearance as Estelle in \"The One with the Butt\", but the scene was cut for timing reasons although it is included in the DVD version of season 1 (she is still mentioned after Joey's play in the original episode that aired). She makes her first proper appearance in \"The One with Russ\", when, after Joey tells Estelle he is fed up of poor roles, she gets him a recurring part in \"Days of Our Lives\". She witnesses Marshall Townend read a critical review of a play he had directed which Joey had starred in and along with everyone else in the room is bemused by the quirks of both Joey and Marshall in \"The One with the Screamer\". Although she is shown to be supportive of Joey's career over the course of the show, in one episode, however, she appears to undermine his career after getting the impression that Joey had left her as an agent, which he in reality had not. She dies in the last season; Joey gives a speech at her memorial service, where it is revealed that her only other client is Al Zebooker, a man who eats paper.", "June Gable (born June 5, 1945) is an American character actress, perhaps best known for her role as Joey's agent Estelle Leonard in the NBC sitcom \"Friends\". She received one Tony Award nomination for her work on Broadway. Gable was born as June Golub in Brooklyn, New York City, the daughter of Joseph and Shirley Golub. She studied acting at Carnegie Mellon University in Pittsburgh. Gable has appeared in four Broadway productions including the 1974 revival of \"Candide\" for which she was nominated for a Tony Award for Best Featured Actress in a Musical for her portrayal of the Old Lady. She was featured as Snooks Keene in the infamous Broadway disaster, \"Moose Murders\", which opened and closed on the same night in 1983. She also appeared in a replacement cast of the off-Broadway revue \"Jacques Brel is Alive and Well and Living in Paris\". In November 2012 she starred in the lead role of \"Marie\" in the world premiere of Bill C. Davis' \"All Hallowed\" at the Waco Civic Theatre in Waco, Texas under the direction of George Boyd.", "Angie Martinelli (portrayed by Lyndsy Fonseca) is a waitress and aspiring actress who befriends Carter. Fonseca was drawn to Martinelli's \"funky personality\", which differed from her much more serious previous role of Alexandra Udinov on \"Nikita\". Fonseca and Atwell discussed keeping their characters as friends, rather than falling to \"jealousy or cattiness. There's nothing but just support and interest and friendship, because a lot of times it's more complicated than that on shows.\" By July 2015, Fonseca was negotiating to return for the second season, and that December she was revealed to be returning for a dream sequence in \"A Little Song and Dance\". Fazekas said that Angie's appearance in the sequence is her acting as Carter's conscience, \"speaking the things that Peggy maybe can\u2019t say to herself. It ties things back together from the first season and it\u2019s connecting all of these things in a way that only a dream can do.\"", "Dawn Trager (Rachel Miner) and Fawn Trager (Lexi Sakowitz) are the daughters of Alex \"Tig\" Trager and his ex-wife Colleen. Dawn first appears in the episode \"With An X.\" Ellie and Kenny Winston (Lela Jane Cortines and John Abendroth) are the daughter and son of Opie and Donna Winston. Agent Estevez (Marcos de la Cruz) is an agent of the Department of Justice, working under Agent Stahl to bring SAMCRO down. David Hale (Taylor Sheridan) is the deputy chief of the Charming Police Department. Chief Unser nicknames him \"Captain America\" for his black-and-white views and squeaky clean image (prior to his involvement with L.O.A.N. and sexual encounter with an ATF agent), adherence to the law and, possibly, because of his square-jawed all-American looks. Hale is murdered at Half-Sack's wake while trying to stop the van of shooters.", "On television, Gable played detective Battista on the sitcom \"Barney Miller\" in the 1976, third season. She was also in the cast of the short-lived 1977 revival of \"Rowan & Martin's Laugh-In\". In 1979 she appeared as \"Rhoda Rooter\" on the live-action Hanna-Barbera TV specials \"Legends of the Superheroes\". From 1978 to 1981, she was regular member In the syndicated variety series \"Sha Na Na\". In 1980s, she guest starred in episodes of popular series including \"Miami Vice\" and \"Kate & Allie\", and well as had small parts in films \"Brenda Starr\" and \"She-Devil\" (both 1989). From 1994 to 2004, Gable played Estelle Leonard of the \"Estelle Leonard Talent Agency\", the agent of the Matt LeBlanc character Joey Tribbiani, on the NBC sitcom \"Friends\", with her character dying in 2004. She played a nurse on the same show in season 1, episode 23. She also appeared in a recurring role in the HBO comedy series \"Dream On\" from 1990 to 1996 playing Libby Friedman.", "Main cast members Clark Gregg, Ming-Na Wen, Chloe Bennet, Iain De Caestecker, Elizabeth Henstridge, and Henry Simmons return from previous seasons as Phil Coulson, Melinda May, Daisy Johnson / Quake, Leo Fitz, Jemma Simmons, and Alphonso \"Mack\" MacKenzie, respectively. Before the 2017 New York Comic-Con, it was revealed that Natalia Cordova-Buckley had been promoted to series regular for the season, after recurring in the past two seasons as Elena \"Yo-Yo\" Rodriguez. De Caestecker also portrays \"The Doctor\", the version of Fitz from the Framework reality.", "After Shakil Kazemi (Shaheen Jafargholi) dies from being stabbed, the teenagers spend time at E20 and during spin the bottle, Tiffany kisses both Bernadette and her half-brother, Keegan Baker (Zack Morris), which leads Bernadette to confusion about her feelings, though Tiffany tells Bernadette she likes Keegan. Despite avoidance from Bernadette, Tiffany understands how Bernadette feels. Tiffany starts a relationship with gang member Jagger Rawley, who uses her to deliver drugs. Tiffany discovers that Jagger has given drugs to Keegan so she bins them; Jagger asks her to pay for them but she is unable to. Tiffany then meets Evie Steele (Sophia Capasso), who stands up for her in front of Jagger. However, Tiffany discovers that Evie is part of the gang. She allows them to use Ted Murray's (Christopher Timothy) flat after she steals his keys and Tiffany is shocked to discover Evie is the leader of the gang. Evie asks Tiffany to deliver a package to Suffolk and tells her she must take Bernadette with her. Tiffany tells Bernadette what is going on and Bernadette agrees to go with her when Tiffany kisses her. In Suffolk Tiffany successfully receives the package of drugs in a crack-den. She deals drugs to Keegan once again and when Bernadette finds out she falls out with her, however Tiffany invites her to the Queen Vic with her and Evie and they make up. Tiffany and Evie then kiss in the toilets witnessed by Bernadette.", "Kaylee Anne DeFer (born September 23, 1986) is a former American actress. She is known for her portrayal of Ivy Dickens in The CW's teen drama series \"Gossip Girl\". DeFer was born in Tucson, Arizona. In 2003, she moved to Los Angeles to pursue a career in acting. DeFer made her acting debut in a March 2004 episode of the Nickelodeon sitcom \"Drake & Josh\". She has since made a number of guest appearances on television shows such as \"Quintuplets\", \"Ghost Whisperer\", \"\", and \"How I Met Your Mother\". DeFer appears on the cover of Reeve Oliver's second album, \"Touchtone Inferno\" (2007).", "Natalia Cordova-Buckley, sometimes credited as Natalia C\u00f3rdova, (born November 25, 1982) is a Mexican actress best known for portraying Elena \"Yo-Yo\" Rodriguez on \"Marvel's Agents of S.H.I.E.L.D.\" Cordova-Buckley began her career as a ballet dancer, training under Fernando Alonso. Finding the occupation too restricting she decided to become an actress instead. She had reconsidered acting after trying to avoid it due to being teased about her voice in her youth. \"The kids wouldn\u2019t chase me around when we played tag because they would say that I screamed like a Godzilla. It wasn\u2019t just my voice, but [also] the fact that I have a pretty strong personality and was always very outspoken and opinionated.\" She looked up to artist Frida Kahlo whom she would portray in voiceover in \"Coco\". Her grandfather is Pancho C\u00f3rdova, an actor in Mexican and American cinema, whom she never got to meet. She moved to the U.S. and studied at University of North Carolina School of the Arts and later earned her first American role in \"McFarland, USA\". She almost quit acting until she won the role of Elena Rodriguez on \"Agents of S.H.I.E.L.D.\", gaining recognition in the process. During the show's fourth season, she headlined a 6-episode miniseries, \"\", which debuted online on December 13, 2016.", "Sicily Sewell (born October 1, 1985) is an American actress. She is sometimes credited in film or television as simply with a mononym Sicily. She made her television appearance on an Emmy Award-winning episode of \"Sesame Street\" when she was eight years old. She played \"Young Aisha\" in a two-part episode of Season 2 of Mighty Morphin Power Rangers called \"\"Rangers Back In Time\"\", as well as in the 10 part mini series Mighty Morphin Alien Rangers. She starred as young Diana in the hit miniseries, \"Mama Flora's Family\" in 1998, and as Angela Bassett's niece in the film \"How Stella Got Her Groove Back\"."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[17, 27], [0, 10], [31, 46], [301, 318], [596, 601], [327, 350], [643, 659], [0, 17], [0, 23], [0, 13]], "rd_topk": 2}, "test_2032": {"question": "When does the shape of water book come out", "answer": ["March 6 , 2018"], "prediction": ["December 22, 2017", "December 1, 2017", "December 1, 2017", "December 22, 2017", "December 23, 2017", "February 6, 2015", "August 31, 2017", "2017", "August 31, 2017", "November 6, 2018"], "score": [83.75920104980469, 82.26226806640625, 81.38088989257812, 80.0206298828125, 79.2261962890625, 78.91384887695312, 78.03913116455078, 77.33106231689453, 76.27717590332031, 75.05647277832031], "title": [["The Shape of Water"], ["The Shape of Water"], ["The Shape of Water"], ["The Shape of Water"], ["The Shape of Water"], ["The SpongeBob Movie: Sponge Out of Water"], ["The Shape of Water"], ["The Shape of Water"], ["The Shape of Water"], ["Whose Boat Is This Boat?"]], "evidence": ["Alexandre Desplat is the composer of the film's score. The score won the Academy Award for Best Original Score at the 90th Academy Awards. \"The Shape of Water\" premiered on August 31, 2017 at the 74th Venice International Film Festival. It also screened at Telluride Film Festival, the 2017 Toronto International Film Festival and BFI London Film Festival, among others. The film was released in two theaters in New York City on December 1, 2017 and then expanded to several other cities the following week. It had its official wide release in the United States on December 22, 2017.", "Alexandre Desplat is the composer of the film's score. The score won the Academy Award for Best Original Score at the 90th Academy Awards. \"The Shape of Water\" premiered on August 31, 2017 at the 74th Venice International Film Festival. It also screened at Telluride Film Festival, the 2017 Toronto International Film Festival and BFI London Film Festival, among others. The film was released in two theaters in New York City on December 1, 2017 and then expanded to several other cities the following week. It had its official wide release in the United States on December 22, 2017.", "The film was screened in the main competition section of the 74th Venice International Film Festival, where it premiered on August 31, 2017, and was awarded the Golden Lion for best film. It was also screened at the 2017 Toronto International Film Festival. It began a limited release in two theaters in New York City on December 1, 2017, before expanding wide on December 23, 2017, and grossed $195 million worldwide. \"The Shape of Water\" received critical acclaim for its acting, screenplay, direction, visuals, production design, and musical score, with many critics calling the film del Toro's best work since \"Pan's Labyrinth\"; the American Film Institute selected it as one of the top 10 films of the year. \"The Shape of Water\" received a number of awards and nominations, including thirteen nominations at the 90th Academy Awards, where it won for Best Picture, Best Director, Best Production Design, and Best Original Score. It was nominated for seven awards at the 75th Golden Globe Awards, winning for Best Director and Best Original Score, twelve at the 71st British Academy Film Awards, winning three awards, including Best Director and fourteen nominations at the 23rd Critics' Choice Awards and won four awards. A novelization by del Toro and Daniel Kraus was published on March 6, 2018.", "On March 13, 2018, the film was released on Blu-ray, DVD and digital download. \"The Shape of Water\" grossed $63.9 million in the United States and Canada, and $131.4 million in other countries, for a total of $195.2 million. After grossing $4.6 million over three weeks of limited release, the film began its wide release on December 22, 2017, alongside the openings of \"Downsizing\", \"Pitch Perfect 3\" and \"Father Figures\", and the wide expansion of \"Darkest Hour\", and grossed $3 million from 726 theaters over the weekend, and $4.4 million over the four-day Christmas frame. The following weekend, the film made $3.5 million. The weekend of January 27, 2018, following the announcement of the film's 13 Oscar nominations, the film was added to over 1,000 theaters (for a total of 1,854) and made $5.9 million (an increase of 171% over the previous week's $2.2 million), finishing 8th. The weekend of March 9\u201311, following its four Oscar wins, the film made $2.4 million. It marked a 64% increase from the previous week's $1.5 million and was similar to the $2.5 million made by the previous year's Best Picture winner, \"Moonlight\".", "The film was screened in the main competition section of the 74th Venice International Film Festival, where it premiered on August 31, 2017, and was awarded the Golden Lion for best film. It was also screened at the 2017 Toronto International Film Festival. It began a limited release in two theaters in New York City on December 1, 2017, before expanding wide on December 23, 2017, and grossed $195 million worldwide. \"The Shape of Water\" received critical acclaim for its acting, screenplay, direction, visuals, production design, and musical score, with many critics calling the film del Toro's best work since \"Pan's Labyrinth\"; the American Film Institute selected it as one of the top 10 films of the year. \"The Shape of Water\" received a number of awards and nominations, including thirteen nominations at the 90th Academy Awards, where it won for Best Picture, Best Director, Best Production Design, and Best Original Score. It was nominated for seven awards at the 75th Golden Globe Awards, winning for Best Director and Best Original Score, twelve at the 71st British Academy Film Awards, winning three awards, including Best Director and fourteen nominations at the 23rd Critics' Choice Awards and won four awards. A novelization by del Toro and Daniel Kraus was published on March 6, 2018.", "\"The SpongeBob Movie: Sponge Out of Water\" was released in the United States on February 6, 2015 and received generally positive reviews. The film grossed over $325 million worldwide against its $74 million budget, making it the fifth-highest-grossing animated film of 2015. A third film, titled , is set to be released on July 17, 2020. A pirate named Burger Beard travels to Bikini Atoll, where he obtains a magical book with the power to make any text written upon it real. The book tells the story of SpongeBob SquarePants and his adventures in the underwater city of Bikini Bottom. SpongeBob loves his job as a fry cook at the Krusty Krab fast food restaurant, where he cooks hamburgers called Krabby Patties and works for Mr. Krabs, the Krusty Krab CEO. He has spent several years prudently protecting the secret Krabby Patty formula from Plankton, the owner of a competing restaurant called the Chum Bucket.", "Alexandre Desplat is the composer of the film's score. The score won the Academy Award for Best Original Score at the 90th Academy Awards. \"The Shape of Water\" premiered on August 31, 2017 at the 74th Venice International Film Festival. It also screened at Telluride Film Festival, the 2017 Toronto International Film Festival and BFI London Film Festival, among others. The film was released in two theaters in New York City on December 1, 2017 and then expanded to several other cities the following week. It had its official wide release in the United States on December 22, 2017.", "The Shape of Water is a 2017 American romantic dark fantasy drama film directed by Guillermo del Toro and written by del Toro and Vanessa Taylor. It stars Sally Hawkins, Michael Shannon, Richard Jenkins, Doug Jones, Michael Stuhlbarg, and Octavia Spencer. Set in Baltimore, Maryland, in 1962, the story follows a mute custodian at a high-security government laboratory who falls in love with a captured humanoid amphibian creature. Filming took place in Ontario, Canada, between August and November 2016.", "The film was screened in the main competition section of the 74th Venice International Film Festival, where it premiered on August 31, 2017, and was awarded the Golden Lion for best film. It was also screened at the 2017 Toronto International Film Festival. It began a limited release in two theaters in New York City on December 1, 2017, before expanding wide on December 23, 2017, and grossed $195 million worldwide. \"The Shape of Water\" received critical acclaim for its acting, screenplay, direction, visuals, production design, and musical score, with many critics calling the film del Toro's best work since \"Pan's Labyrinth\"; the American Film Institute selected it as one of the top 10 films of the year. \"The Shape of Water\" received a number of awards and nominations, including thirteen nominations at the 90th Academy Awards, where it won for Best Picture, Best Director, Best Production Design, and Best Original Score. It was nominated for seven awards at the 75th Golden Globe Awards, winning for Best Director and Best Original Score, twelve at the 71st British Academy Film Awards, winning three awards, including Best Director and fourteen nominations at the 23rd Critics' Choice Awards and won four awards. A novelization by del Toro and Daniel Kraus was published on March 6, 2018.", "The book's blurb describes it as \"An excellent teaching tool for readers of all ages who enjoy learning about empathy by process of elimination.\" Colbert reflected upon the announcement of the book, \"It's the perfect gift for young readers and presidents who don't read.\" Simon & Schuster's press release says \"Research suggests this will be the first children's book ever published that demonstrates what not to say after a natural disaster.\" It also quotes company president Jonathan Karp, who wrote: Donald Trump has described himself as the Ernest Hemingway of Twitter. With this book, he proves himself to be the Dr. Seuss of hurricane literature. The book was released on November 6, 2018, the same day as the 2018 U.S. midterm elections. As of September 30, 2018, it was the number one best selling book on Amazon.com, according to a tweet sent by Colbert. As of the week of October 21, 2018, it was the second best selling non-fiction book on the site."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0.6666666666666666, "se_pos": [[565, 582], [429, 445], [321, 337], [325, 342], [364, 381], [80, 96], [173, 188], [24, 28], [124, 139], [678, 694]], "rd_topk": 2}, "test_2033": {"question": "Who caused to build Qutub Minar in Delhi", "answer": ["Iltutmish", "Firoz Shah Tughlaq"], "prediction": ["Qutub-ud-din Aibak", "Shah Jahan", "Qutb-ud-din Aibak,", "Mughal emperor, Shah Jahan", "Qutub-ud-Din Aibak,", "Qutab-Ud-Din-Aibak,", "Shah Jahan", "Q", "Qutb-ud-din", "Shah Jahan"], "score": [81.61758422851562, 81.27011108398438, 80.262451171875, 79.39608764648438, 79.08109283447266, 77.8846206665039, 76.60646057128906, 75.95891571044922, 75.69554138183594, 75.01969909667969], "title": [["List of tourist attractions in Delhi"], ["Mini Qutub Minar"], ["Qutb Minar complex"], ["Mini Qutub Minar"], ["Architecture of India"], ["Qutb Minar"], ["Mini Qutub Minar"], ["Qutb Minar"], ["History of Delhi"], ["Mini Qutub Minar"]], "evidence": ["The Safdarjung's Tomb is a garden tomb in a marble mausoleum. Humayun's tomb is the tomb of the Mughal emperor Humayun that was commissioned by Humayun's wife and chief consort, Empress Bega Begum in 1569. It is a UNESCO World Heritage Site. The Qutub Minar is located in Qutb complex, Mehrauli in South Delhi. It was built by Qutub-ud-din Aibak of the Slave Dynasty, founder of the Delhi Sultanate, started construction of the Qutub Minar's first storey around 1192. In 1220, Aibak's successor and son-in-law Iltutmish completed a further three storeys. In 1369, a lightning strike destroyed the top storey. Firoz Shah Tughlaq replaced the damaged storey, and added one more.. It is a fluted red sandstone tower, which tapers up to a height of 72.5 meters and is covered with intricate carvings and verses from the Qur'an.", "The Mini Qutub Minar (\"local:\" Chhota Qutub Minar, Mini Minar, Kaushal Minar, Hastsal ki Laat) is a minaret tower in Hastsal village in Uttam Nagar, West Delhi, India. It was built in the 1650 by Mughal emperor, Shah Jahan (reign, 1628-1658) near his hunting lodge in Hasthal. The three storeyed tower is 16.87 meters (55 feet) tall and stands on a raised octagonal platform. The minar is built with bricks and clad with red sandstone. The tower structure and design resembles the Qutub Minar of Delhi and was inspired by it.", "The Qutb complex is a collection of monuments and buildings from the Delhi Sultanate at Mehrauli in Delhi in India. The Qutub Minar in the complex, named after Qutbuddin Bakhtiar Kaki, was built by Qutb-ud-din Aibak, who later became the first Sultan of Delhi of the Mamluk dynasty. The Minar was added upon by his successor Iltutmish (a.k.a. Altamash), and much later by Firoz Shah Tughlaq, a Sultan of Delhi from the Tughlaq dynasty in 1368 AD. The Qubbat-ul-Islam Mosque (Dome of Islam), later corrupted into Quwwat-ul Islam, stands next to the Qutb Minar.", "The Mini Qutub Minar (\"local:\" Chhota Qutub Minar, Mini Minar, Kaushal Minar, Hastsal ki Laat) is a minaret tower in Hastsal village in Uttam Nagar, West Delhi, India. It was built in the 1650 by Mughal emperor, Shah Jahan (reign, 1628-1658) near his hunting lodge in Hasthal. The three storeyed tower is 16.87 meters (55 feet) tall and stands on a raised octagonal platform. The minar is built with bricks and clad with red sandstone. The tower structure and design resembles the Qutub Minar of Delhi and was inspired by it.", "The earliest examples of Indo-Islamic Architecture were constructed during this period by the Delhi Sultanates, most famously the Qutb Minar complex, which was designated a UNESCO World Heritage Site in 1993. The complex consists of Qutb Minar, a brick minaret commissioned by Qutub-ud-Din Aibak, as well as other monuments built by successive Delhi Sultans. Alai Minar, a minaret twice the size of Qutb Minar was commissioned by Alauddin Khilji but never completed. The Mughal architecture and painting influenced indigenous Rajput styles of art and architecture. Rajput Architecture represents different types of buildings, which may broadly be classed either as secular or religious. The secular buildings are of various scales. These include temples, forts, stepwells, gardens, and palaces. The forts were specially built for defense and military purposes due to the Islamic invasions.", "The Qutub Minar, also spelled as Qutab Minar, or Qutb Minar, is a minaret that forms part of the Qutab complex, a UNESCO World Heritage Site in the Mehrauli area of Delhi, India. Qutub Minar is a 73-metre (239.5 feet) tall tapering tower of five storeys, with a 14.3 metres (47 feet) base diameter, reducing to 2.7 metres (9 feet) at the top of the peak. It contains a spiral staircase of 379 steps. Its design is thought to have been based on the Minaret of Jam, in western Afghanistan. Qutab-Ud-Din-Aibak, founder of the Delhi Sultanate, started construction of the Qutub Minar's first storey around 1192. In 1220, Aibak's successor and son-in-law Shamsuddin Iltutmish completed a further three storeys. In 1369, a lightning strike destroyed the top storey. Firoz Shah Tughlaq replaced the damaged storey, and added one more. Sher Shah Suri also added an entrance to this tower while he was ruling and Humayun was in exile.", "In the past, the Hastsal area where the Minar is located, used to be submerged in water and it used to be elephants corridor and resting place. The origin of the area name \u2018Hastsal' indicates this with haathi (elephant) and sthal (place). In the early 17th century, Mughal emperor, Shah Jahan used Hastsal as one of his hunting lodges. In 1650, he commissioned the construction of a tall minaret similar to Qutub Minar in Delhi. When completed, the Mini Qutub Minar was much higher than it is now. It was a tall 5 storey tower with an internal stairway leading to the domed Chhatri pavilion at the top. It was a gorgeous hunting pavilion tower in the center of an encompassing wilderness. The emperor rested in the tower top, royally-entertained with his immediate retinue after hunting in the surrounding wilderness.", "The Qutub Minar, also spelled as Qutab Minar, or Qutb Minar, is a minaret that forms part of the Qutab complex, a UNESCO World Heritage Site in the Mehrauli area of Delhi, India. Qutub Minar is a 73-metre (239.5 feet) tall tapering tower of five storeys, with a 14.3 metres (47 feet) base diameter, reducing to 2.7 metres (9 feet) at the top of the peak. It contains a spiral staircase of 379 steps. Its design is thought to have been based on the Minaret of Jam, in western Afghanistan. Qutab-Ud-Din-Aibak, founder of the Delhi Sultanate, started construction of the Qutub Minar's first storey around 1192. In 1220, Aibak's successor and son-in-law Shamsuddin Iltutmish completed a further three storeys. In 1369, a lightning strike destroyed the top storey. Firoz Shah Tughlaq replaced the damaged storey, and added one more. Sher Shah Suri also added an entrance to this tower while he was ruling and Humayun was in exile.", "From 1206, Delhi became the capital of the Delhi Sultanate under the Slave Dynasty. The first Sultan of Delhi, Qutb-ud-din Aybak, was a former slave who rose through the ranks to become a general, a governor and then Sultan of Delhi. Qutb-ud-din started the construction of the Qutub Minar, a recognisable symbol of Delhi, to commemorate his victory but died before its completion. In the Qutb complex he also constructed the Quwwat-al-Islam (might of Islam), which is the earliest extant mosque in India. He was said to have destroyed twenty-seven Jain temples initially housed in the Qutb complex and pillaged exquisitely carved pillars and building material from their debris for this mosque, many of which can still be seen. After the end of the Slave dynasty, a succession of Turkic Central Asian and Afghan dynasties, the Khalji dynasty, the Tughluq dynasty, the Sayyid dynasty and the Lodi dynasty held power in the late medieval period and built a sequence of forts and townships in Delhi.", "Originally, the Mini Qutub Minar was a 5 storeyed tower, topped out with a domed Chhatri pavilion at the top. It was used by emperor Shah Jahan for his entertainment after hunting in the all encompassing wilderness that used to surround this colossal Hastsal minaret and royal hunting lodge. The emperor's Shikargah or hunting lodge is situated a few hundred metres from the minaret tower. The Mini Qutub Minar is a 'Grade A' listed, protected heritage monument with the Department of Archaeology, India."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0.4, "se_pos": [[327, 345], [212, 222], [198, 216], [196, 222], [277, 296], [488, 507], [282, 292], [488, 489], [234, 245], [133, 143]], "rd_topk": 2}, "test_2034": {"question": "When did the wall go up in East Germany", "answer": [") , starting on"], "prediction": ["13 August 1961", "August 13, 1961", "13 August 1961", "August 13, 1961", "August 13, 1961", "August 13, 1961", "13 August 1961", "1961", "1961", "13 August 1961"], "score": [89.18815612792969, 88.720947265625, 88.176513671875, 88.02843475341797, 87.61131286621094, 87.52568054199219, 87.19746398925781, 87.13640594482422, 86.95697021484375, 86.62154388427734], "title": [["Consequences of Nazism"], ["Checkpoint Charlie"], ["Berlin Wall"], ["Eastern Bloc emigration and defection"], ["Illegal emigration"], ["List of Soviet and Eastern Bloc defectors"], ["Berlin outer ring"], ["Iron Curtain"], ["West Berlin"], ["History of Germany (1945\u201390)"]], "evidence": ["During the Cold War, it was difficult for West Germans to visit East German relatives and friends and impossible vice versa. For East Germans, especially after the building of the Berlin Wall on 13 August 1961 and until Hungary opened up its border to the West in the late 1980s, thus allowing hundreds of thousands of vacationing East Germans to flee into Western Europe, it was only possible to get to West Germany by illegally fleeing across heavily fortified and guarded border areas. 44 years after the end of World War II, the Berlin Wall fell on 9 November 1989. The East and West parts of Germany were reunited on 3 October 1990.", "The brain drain of professionals had become so damaging to the political credibility and economic viability of East Germany that the re-securing of the Soviet imperial frontier was imperative. Between 1949 and 1961, over 2\u00bd million East Germans fled to the West. The numbers increased during the three years before the Berlin Wall was erected, with 144,000 in 1959, 199,000 in 1960 and 207,000 in the first seven months of 1961 alone. The East German economy suffered accordingly. On August 13, 1961, a barbed-wire barrier that would become the Berlin Wall separating East and West Berlin was erected by the East Germans. Two days later, police and army engineers began to construct a more permanent concrete wall. Along with the wall, the 830 mile zonal border became 3.5 miles wide on its East German side in some parts of Germany with a tall steel-mesh fence running along a \"death strip\" bordered by mines, as well as channels of ploughed earth, to slow escapees and more easily reveal their footprints.", "The Berlin Wall (, ) was a guarded concrete barrier that physically and ideologically divided Berlin from 1961 to 1989. Constructed by the German Democratic Republic (GDR, East Germany), starting on 13 August 1961, the Wall cut off (by land) West Berlin from virtually all of surrounding East Germany and East Berlin until government officials opened it in November 1989. Its demolition officially began on 13 June 1990 and finished in 1992. The barrier included guard towers placed along large concrete walls, accompanied by a wide area (later known as the \"death strip\") that contained anti-vehicle trenches, \"fakir beds\" and other defenses. The Eastern Bloc portrayed the Wall as protecting its population from fascist elements conspiring to prevent the \"will of the people\" in building a socialist state in East Germany.", "On August 13, 1961, a barbed-wire barrier that would become the Berlin Wall separating East and West Berlin was erected by East Germany. Two days later, police and army engineers began to construct a more permanent concrete wall. The construction briefly caused fears of a military crisis, though only 11,000 western troops were located in Berlin compared to 500,000 Soviet troops surrounding them deployed in East Germany. The completion of the Berlin Wall closed the biggest loophole in the Iron Curtain. It brought an end to a decade during which divided capital of the divided Germany was the easiest place for unauthorized east-to-west crossings. Along with the wall, the zonal border became wide on its East German side in some parts of Germany with a tall steel-mesh fence running along a \"death strip\" bordered by bands of plowed earth, to slow and to reveal the prints of those trying to escape, and mined fields.", "By the early 1950s, the Soviet approach to controlling national movement was emulated by most of the rest of the Eastern Bloc (along with China, Mongolia and North Korea). Up until 1952, the lines between East Germany and the western occupied zones could be easily crossed in most places. Accordingly, before 1961, most of that east-west flow took place between East and West Germany, with over 3.5 million East Germans emigrating to West Germany. On August 13, 1961, barbed-wire barrier that would become the Berlin Wall separating East and West Berlin was erected by East Germany. Two days later, police and army engineers began to construct a more permanent concrete wall.", "Soon after the formation of the Soviet Union, emigration restrictions were put in place to keep citizens from leaving the various countries of the Soviet Socialist Republics, though some defections still occurred. During and after World War II, similar restrictions were put in place in non-Soviet countries of the Eastern Bloc, which consisted of the Communist states of Eastern Europe. Until 1952, however, the lines between Communist East Germany and the western occupied zones could be easily crossed in most places. Accordingly, before 1961, most of that east-west flow took place between East and West Germany, with over 3.5 million East Germans emigrating to West Germany before 1961. On August 13, 1961, a barbed-wire barrier, which would become the Berlin Wall separating East and West Berlin, was erected by East Germany.", "In 1958, passenger trains began running on the outer ring as part of the Berlin S-Bahn fare scheme. As this followed the launch of the first Soviet satellite, these trains, which ran partly on a circular orbit around West Berlin, were commonly called \"Sputniks\u201d. On 13 August 1961, the Berlin Wall was built closing East Germany\u2019s border with West Berlin. This made necessary the construction of an S-Bahn connection between Berlin-Blankenburg and Hohen Neuendorf towards Oranienburg. In 1962 separate S-Bahn tracks between Sch\u00f6nflie\u00df and Bergfelde were put into operation (on the rest of the section S-Bahn and mainline trains shared tracks) and the connection between Bergfelde/Bergfelde East and Birkenwerder were built. Also in 1962 an S-Bahn line from Adlershof station to Berlin-Schoenefeld Airport was opened and this line also made available for long-distance trains. Previously, it had served only as a station for border checkpoint purposes.", "About 10% were refugees permitted to emigrate under the Geneva Convention of 1951. Most Soviets allowed to leave during this time period were ethnic Jews permitted to emigrate to Israel after a series of embarrassing defections in 1970 caused the Soviets to open very limited ethnic emigrations. The fall of the Iron Curtain was accompanied by a massive rise in European East-West migration. The Iron Curtain took physical shape in the form of border defenses between the countries of western and eastern Europe. There were some of the most heavily militarised areas in the world, particularly the so-called \"inner German border\" \u2013 commonly known as \"die Grenze\" in German \u2013 between East and West Germany. The inner German border was marked in rural areas by double fences made of steel mesh (expanded metal) with sharp edges, while near urban areas a high concrete barrier similar to the Berlin Wall was built. The installation of the Wall in 1961 brought an end to a decade during which the divided capital of divided Germany was one of the easiest places to move west across the Iron Curtain.", "West Berlin was east and north of the Inner German border and only accessible by land from West Germany by narrow rail and highway corridors. It consisted of the American, British, and French occupation sectors established in 1945. The Berlin Wall, built in 1961, physically separated West Berlin from its East Berlin and East German surroundings until it fell in 1989. The Potsdam Agreement established the legal framework for the occupation of Germany in the wake of World War II. According to this agreement, Germany would be formally under the administration of the three major wartime Allies (the United States, the United Kingdom, and the Soviet Union) as well as France until a German government \"acceptable to all parties\" could be established. The territory of Germany, as it existed in 1937, would be reduced by most of \"Eastern Germany\" thus creating the former eastern territories of Germany. The remaining territory would be divided into four zones, each administered by one of the four allied countries. Berlin, which was surrounded by the Soviet zone of occupation\u2014newly established in most of Middle Germany\u2014would be similarly divided, with the Western Allies occupying an enclave consisting of the western parts of the city. According to the agreement, the occupation of Berlin could end only as a result of a quadripartite agreement. The Western Allies were guaranteed three air corridors to their sectors of Berlin, and the Soviets also informally allowed road and rail access between West Berlin and the western parts of Germany (see section on traffic).", "Government offices have been moving progressively to Berlin, and it became the formal seat of the federal government in 1999. Berlin also is one of the Federal Republic's 16 \"L\u00e4nder\". Under Chancellor Adenauer West Germany declared its right to speak for the entire German nation with an exclusive mandate. The Hallstein Doctrine involved non-recognition of East Germany and restricted (or often ceased) diplomatic relations with countries that gave East Germany the status of a sovereign state. The constant stream of East Germans fleeing across the Inner German border to West Germany placed great strains on East German-West German relations in the 1950s. East Germany sealed the borders to West Germany in 1952, but people continued to flee from East Berlin to West Berlin. On 13 August 1961, East Germany began building the Berlin Wall around West Berlin to slow the flood of refugees to a trickle, effectively cutting the city in half and making West Berlin an enclave of the Western world in communist territory. The Wall became the symbol of the Cold War and the division of Europe. Shortly afterward, the main border between the two German states was fortified."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[195, 209], [484, 499], [199, 213], [3, 18], [451, 466], [695, 710], [266, 280], [944, 948], [258, 262], [781, 795]], "rd_topk": 4}, "test_2035": {"question": "Winner of first series of great British Bake off", "answer": ["Edd Kimber"], "prediction": ["Edd Kimber", "Ed", "Joanne Wheatley.", "Edd Kimber", "Frances Quinn", "John Whaite.", "Nadiya Hussain,", "Nancy Birtwhistle,", "Sophie Faldo", "Rahul Mandal"], "score": [97.21746063232422, 92.78630065917969, 91.25811767578125, 90.63809204101562, 90.05314636230469, 89.50436401367188, 89.19216918945312, 89.10292053222656, 89.03871154785156, 88.35110473632812], "title": [["The Great British Bake Off (series 1)"], ["The Great British Bake Off (series 1)"], ["The Great British Bake Off (series 2)"], ["The Great British Bake Off"], ["The Great British Bake Off (series 4)"], ["The Great British Bake Off (series 3)"], ["The Great British Bake Off (series 6)"], ["The Great British Bake Off (series 5)"], ["The Great British Bake Off (series 8)"], ["The Great British Bake Off (series 9)"]], "evidence": ["The first series of \"The Great British Bake Off\", first aired on BBC Two on 17 August 2010. Ten home bakers took part in a bake-off to test every aspect of their baking skills as they battled to be crowned the Great British Bake Off's best amateur baker. Each week the nationwide tour saw bakers put through three challenges in a particular discipline, with some being eliminated from competition at the end of the episode. The rounds of the competition took place in various locations across the UK following a theme, for example, the episode on puddings would take place in Bakewell, bread baking would take place near Sandwich. This first series had a voiceover by Stephen Noonan; for the subsequent series this role was taken by the on-screen presenters Mel Giedroyc and Sue Perkins. The competition was won by Edd Kimber.", "The first series of \"The Great British Bake Off\", first aired on BBC Two on 17 August 2010. Ten home bakers took part in a bake-off to test every aspect of their baking skills as they battled to be crowned the Great British Bake Off's best amateur baker. Each week the nationwide tour saw bakers put through three challenges in a particular discipline, with some being eliminated from competition at the end of the episode. The rounds of the competition took place in various locations across the UK following a theme, for example, the episode on puddings would take place in Bakewell, bread baking would take place near Sandwich. This first series had a voiceover by Stephen Noonan; for the subsequent series this role was taken by the on-screen presenters Mel Giedroyc and Sue Perkins. The competition was won by Edd Kimber.", "Three and a half thousand people applied for the competition, and 12 were selected. Each episode was filmed over two 14-hour days. The competition was won by Joanne Wheatley. There was no Star Baker this week, as Paul and Mary felt it wouldn't be right to single out one baker when the results were incredibly close. Colour key: For their very first challenge, the bakers were asked to bake 24 cupcakes in 2 hours. They are allowed to make 2 different types of cupcakes. For the technical challenge, the bakers were asked to bake a Coffee and Walnut Battenburg cake using Mary Berry's recipe. The cake needs to have the perfect sponge which holds its form (perfect symmetry), distinguish flavors, and a smooth exterior. For the showstopper, the bakers were asked to bake a chocolate tiered celebration cake with elaborate, multi-layer design.", "The programme was originally presented by Sue Perkins and Mel Giedroyc, with judges Mary Berry and Paul Hollywood. The current presenters are Noel Fielding and Sandi Toksvig, with Hollywood and Prue Leith as the judges. In chronological order, the winners are Edd Kimber, Joanne Wheatley, John Whaite, Frances Quinn, Nancy Birtwhistle, Nadiya Hussain, Candice Brown, Sophie Faldo and Rahul Mandal. The show has become a significant part of British culture and is credited with reinvigorating interest in baking throughout the United Kingdom and Ireland, with many of its participants, including winners, having gone on to start a career based on bakery, while the BAFTA award-winning programme has spawned a number of specials and spin-off shows: a celebrity charity series in aid of Sport Relief/Comic Relief or Stand Up to Cancer; \"Junior Bake Off\" for young children (broadcast on the CBBC channel); after-show series \"\"; and \"\" for teams of pastry chefs. The show's format was used as the basis for two BBC Two series, \"The Great British Sewing Bee\" and \"The Great Pottery Throw Down\". Under the title The Great British Baking Show, \"Bake Off\" has been shown in the United States and Canada. It also has appeared in other countries, and the format has been sold to television producers in many countries around the world, where local versions are made.", "The winner of the Great British Bake Off 2013 was Frances Quinn. Colour key: The bakers were given two hours to make a sandwich cake with filling of their choice for the signature challenge. For their first technical challenge, the bakers were required to bake an angel food cake using Mary Berry's recipe in two and half hours. For the showstopper, the challenge was to make a chocolate cake using at least two types of chocolate to decorate the cake. They were given four hours for this bake. The bakers were asked to make in two hours 36 breadsticks, all made using yeast, of at least 25 cm (10 inches) in length, and the breadsticks should be crisp and produce a good snap. For the technical challenge, the bakers have to make eight English muffins using Paul's recipe in two and three quarter hours. For the final bake, an elaborately decorated loaf was set as the showstopper challenge to be completed in four hours.", "The third series of \"The Great British Bake Off\" began airing on Tuesday 14 August 2012. The series was filmed at Harptree Court in East Harptree, Somerset. Seven thousand applied for the competition and twelve contestants were chosen. For the first time, all three finalists were male: Brendan Lynch, John Whaite and James Morton. The competition was won by John Whaite. No one was eliminated this week due to John having injured his finger and could not complete the last bake, and the judges thought it would be unfair to eliminate anyone. Two were eliminated the next week.", "The sixth series of \"The Great British Bake Off\" first aired on 5 August 2015, with twelve contestants competing to be crowned the series 6 winner. Mel Giedroyc and Sue Perkins presented the show, and Mary Berry and Paul Hollywood returned as judges. The competition was held in the ground of Welford Park, Berkshire for a second year. The series was won by Nadiya Hussain, with Tamal Ray and Ian Cumming finishing as runners-up. Colour key: For the first challenge, the bakers were given two hours to make a Madeira Cake, which was chosen as an \"easy\" challenge for the bakers. The cake should have a dome and a crack on top, though Mary stated the cake should not differ too far from the original. For the technical challenge, the bakers had one and three quarter hours to make Mary's recipe for a Frosted Walnut Cake, which should have three layers and a meringue coating, along with caramelised walnuts. A Black Forest G\u00e2teau was set as the final challenge. In three and a half hours, the bakers were tasked with making a cake that should be extravagant, and should \"impress\" Mary and Paul.", "The fifth series of \"The Great British Bake Off\" began on Wednesday 6 August 2014. Mel Giedroyc and Sue Perkins presented the show and Mary Berry and Paul Hollywood returned as judges. Twelve contestants competed in this series, and the competition was held in Welford Park in Berkshire. The series was won by Nancy Birtwhistle, with Luis Troyano and Richard Burr finishing as runners-up. The programme was moved from BBC Two to BBC One starting this year, however the Masterclass episodes remained on BBC Two. A companion series \"\" hosted by comedian Jo Brand started this year was also shown on BBC Two.", "The eighth series of \"The Great British Bake Off\" began on 29 August 2017, with this being the first of \"The Great British Bake Off\" to be broadcast on Channel 4, after the production company Love Productions moved the show. It is the first series for new hosts Noel Fielding and Sandi Toksvig, and new judge Prue Leith. This series was won by Sophie Faldo, with Kate Lyon and Steven Carter-Bailey finishing as runners-up. Colour key: For the first challenge, the bakers were instructed to make a cake using fresh fruit, with no dried fruit permitted, in two hours. For the technical challenge, the bakers were instructed to make 12 chocolate mini rolls using Prue's recipe which contains peppermint cream, in two hours. The showstopper challenge required the bakers to make an illusion cake: a cake that appears to be some other object. They had four hours to complete the task.", "The ninth series of \"The Great British Bake Off\" began on 28 August 2018, with this being the second series to be broadcast on Channel 4. The series is presented by Noel Fielding and Sandi Toksvig, with judges Paul Hollywood and Prue Leith. The series was won by Rahul Mandal, with Kim-Joy Hewlett and Ruby Bhogal as the runners-up. Colour key: Breaking with tradition, this year the series kicked off with Biscuits week. For the first challenge of the series, the bakers were tasked to bake 24 regional biscuits that needed to be all identical, and said something about them and a place in the British Isles. For the first technical challenge of this series, they are tasked to make one of Paul's childhood favourites - Wagon Wheels. Finally, for the showstopper, the bakers had to create a spectacular 3D biscuit self-portrait that needed to be constructed with layers of biscuits and judged while placed upright on an easel stand."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[815, 825], [815, 817], [158, 174], [260, 270], [50, 63], [359, 371], [358, 373], [310, 328], [344, 356], [263, 275]], "rd_topk": 2}, "test_2036": {"question": "Where does the UN Security Council get troops for military actions", "answer": ["member states", "member states of the UN"], "prediction": ["member states", "member states", "UN peacekeepers, military forces voluntarily provided by member states", "member states", "the United Nations itself", "the United Nations", "member states of the UN", "UN peacekeepers", "overseas", "the Security Council"], "score": [88.60556030273438, 87.3056640625, 87.23904418945312, 86.46249389648438, 86.02253723144531, 85.4190673828125, 85.26800537109375, 85.20670318603516, 84.49971771240234, 83.86111450195312], "title": [["United Nations Security Council"], ["United Nations"], ["United Nations Security Council"], ["United Nations Security Council"], ["List of United Nations peacekeeping missions"], ["List of United Nations peacekeeping missions"], ["Peace"], ["United Nations Security Council"], ["Military equipment of Israel"], ["List of United Nations peacekeeping missions"]], "evidence": ["Security Council resolutions are typically enforced by UN peacekeepers, military forces voluntarily provided by member states and funded independently of the main UN budget. , 103,510 peacekeepers and 16,471 civilians were deployed on sixteen peacekeeping operations and one special political mission. In the century prior to the UN's creation, several international treaty organizations and conferences had been formed to regulate conflicts between nations, such as the International Committee of the Red Cross and the Hague Conventions of 1899 and 1907. Following the catastrophic loss of life in World War I, the Paris Peace Conference established the League of Nations to maintain harmony between the nations. This organization successfully resolved some territorial disputes and created international structures for areas such as postal mail, aviation, and opium control, some of which would later be absorbed into the UN. However, the League lacked representation for colonial peoples (then half the world's population) and significant participation from several major powers, including the US, USSR, Germany, and Japan; it failed to act against the 1931 Japanese invasion of Manchuria, the Second Italo-Ethiopian War in 1935, the 1937 Japanese occupation of China, and Nazi expansions under Adolf Hitler that escalated into World War II.", "The UN, after approval by the Security Council, sends peacekeepers to regions where armed conflict has recently ceased or paused to enforce the terms of peace agreements and to discourage combatants from resuming hostilities. Since the UN does not maintain its own military, peacekeeping forces are voluntarily provided by member states. These soldiers are sometimes nicknamed \"Blue Helmets\" for their distinctive gear. The peacekeeping force as a whole received the Nobel Peace Prize in 1988. In September 2013, the UN had peacekeeping soldiers deployed on 15 missions. The largest was the United Nations Organization Stabilization Mission in the Democratic Republic of the Congo (MONUSCO), which included 20,688 uniformed personnel. The smallest, United Nations Military Observer Group in India and Pakistan (UNMOGIP), included 42 uniformed personnel responsible for monitoring the ceasefire in Jammu and Kashmir. UN peacekeepers with the United Nations Truce Supervision Organization (UNTSO) have been stationed in the Middle East since 1948, the longest-running active peacekeeping mission.", "Security Council resolutions are typically enforced by UN peacekeepers, military forces voluntarily provided by member states and funded independently of the main UN budget. , 103,510 peacekeepers and 16,471 civilians were deployed on sixteen peacekeeping operations and one special political mission. In the century prior to the UN's creation, several international treaty organizations and conferences had been formed to regulate conflicts between nations, such as the International Committee of the Red Cross and the Hague Conventions of 1899 and 1907. Following the catastrophic loss of life in World War I, the Paris Peace Conference established the League of Nations to maintain harmony between the nations. This organization successfully resolved some territorial disputes and created international structures for areas such as postal mail, aviation, and opium control, some of which would later be absorbed into the UN. However, the League lacked representation for colonial peoples (then half the world's population) and significant participation from several major powers, including the US, USSR, Germany, and Japan; it failed to act against the 1931 Japanese invasion of Manchuria, the Second Italo-Ethiopian War in 1935, the 1937 Japanese occupation of China, and Nazi expansions under Adolf Hitler that escalated into World War II.", "After approval by the Security Council, the UN may send peacekeepers to regions where armed conflict has recently ceased or paused to enforce the terms of peace agreements and to discourage combatants from resuming hostilities. Since the UN does not maintain its own military, peacekeeping forces are voluntarily provided by member states. These soldiers are sometimes nicknamed \"Blue Helmets\" for their distinctive gear. The peacekeeping force as a whole received the Nobel Peace Prize in 1988. In September 2013, the UN had 116,837 peacekeeping soldiers and other personnel deployed on 15 missions. The largest was the United Nations Organization Stabilization Mission in the Democratic Republic of the Congo (MONUSCO), which included 20,688 uniformed personnel. The smallest, United Nations Military Observer Group in India and Pakistan (UNMOGIP), included 42 uniformed personnel responsible for monitoring the ceasefire in Jammu and Kashmir. Peacekeepers with the United Nations Truce Supervision Organization (UNTSO) have been stationed in the Middle East since 1948, the longest-running active peacekeeping mission.", "The Charter of the United Nations gives the Security Council the power and responsibility to take collective action to maintain international peace and security. For this reason, the international community usually looks to the Security Council to authorize peacekeeping operations. Most of these operations are established and implemented by the United Nations itself with troops serving under UN operational command. In other cases, where direct UN involvement is nt functions, including diplomatic relations with other countries, international bodies of justice (such as the International Criminal Court), and eliminating problems such as landmines that can lead to new incidents of fighting.", "The Charter of the United Nations gives the Security Council the power and responsibility to take collective action to maintain international peace and security. For this reason, the international community usually looks to the Security Council to authorize peacekeeping operations. Most of these operations are established and implemented by the United Nations itself with troops serving under UN operational command. In other cases, where direct UN involvement is nt functions, including diplomatic relations with other countries, international bodies of justice (such as the International Criminal Court), and eliminating problems such as landmines that can lead to new incidents of fighting.", "The United Nations (UN) is an international organization whose stated aims are to facilitate cooperation in international law, international security, economic development, social progress, human rights, and achieving world peace. The UN was founded in 1945 after World War II to replace the League of Nations, to stop wars between countries, and to provide a platform for dialogue. The UN, after approval by the Security Council, sends peacekeepers to regions where armed conflict has recently ceased or paused to enforce the terms of peace agreements and to discourage combatants from resuming hostilities. Since the UN does not maintain its own military, peacekeeping forces are voluntarily provided by member states of the UN. The forces, also called the \"Blue Helmets\", who enforce UN accords are awarded United Nations Medals, which are considered international decorations instead of military decorations. The peacekeeping force as a whole received the Nobel Peace Prize in 1988.", "Security Council resolutions are typically enforced by UN peacekeepers, military forces voluntarily provided by member states and funded independently of the main UN budget. , 103,510 peacekeepers and 16,471 civilians were deployed on sixteen peacekeeping operations and one special political mission. In the century prior to the UN's creation, several international treaty organizations and conferences had been formed to regulate conflicts between nations, such as the International Committee of the Red Cross and the Hague Conventions of 1899 and 1907. Following the catastrophic loss of life in World War I, the Paris Peace Conference established the League of Nations to maintain harmony between the nations. This organization successfully resolved some territorial disputes and created international structures for areas such as postal mail, aviation, and opium control, some of which would later be absorbed into the UN. However, the League lacked representation for colonial peoples (then half the world's population) and significant participation from several major powers, including the US, USSR, Germany, and Japan; it failed to act against the 1931 Japanese invasion of Manchuria, the Second Italo-Ethiopian War in 1935, the 1937 Japanese occupation of China, and Nazi expansions under Adolf Hitler that escalated into World War II.", "The military equipment of Israel includes a wide array of arms, armored vehicles, artillery, missiles, planes, helicopters, and warships. Many of these are purchased overseas and many are indigenous designs. Until the Six-Day War of 1967, the Israel Defense Forces' principal supplier was France; since then, it has been the United States government and defense companies. In the early 21st century, Israeli companies such as Soltam Systems began selling arms to the United States. Much of the military equipment undergoes improvements in Israeli workshops. In addition to weapons purchased overseas and indigenous products, Israel also operates and maintains large stockpiles of Soviet-made equipment captured from Arab armies over the course of the Arab\u2013Israeli conflict.", "The Charter of the United Nations gives the Security Council the power and responsibility to take collective action to maintain international peace and security. For this reason, the international community usually looks to the Security Council to authorize peacekeeping operations. Most of these operations are established and implemented by the United Nations itself with troops serving under UN operational command. In other cases, where direct UN involvement is nt functions, including diplomatic relations with other countries, international bodies of justice (such as the International Criminal Court), and eliminating problems such as landmines that can lead to new incidents of fighting."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[112, 125], [323, 336], [55, 125], [325, 338], [343, 368], [343, 361], [706, 729], [55, 70], [166, 174], [40, 60]], "rd_topk": 3}, "test_2037": {"question": "Who plays the voice of Sulley in monsters Inc", "answer": ["John Goodman"], "prediction": ["John Goodman", "John Goodman", "John Goodman", "John Goodman", "John Kahrs", "John Goodman", "Christopher Swindle", "Steve Buscemi", "James Coburn", "Boo (voiced by Mary Gibbs"], "score": [97.01434326171875, 94.35566711425781, 93.74423217773438, 91.69680786132812, 91.62471008300781, 91.61839294433594, 87.35122680664062, 86.87047576904297, 86.76415252685547, 86.03630065917969], "title": [["Monsters, Inc. Scream Team"], ["Monsters, Inc."], ["List of Monsters, Inc. characters"], ["Monsters, Inc."], ["Monsters, Inc."], ["Monsters, Inc."], ["Kingdom Hearts III"], ["List of Monsters, Inc. characters"], ["List of Monsters, Inc. characters"], ["List of Monsters, Inc. characters"]], "evidence": ["Items used include Extra Try Tokens (that gives extra lives to the player), Monsters, Inc. Tokens (that earn silver medals for every ten collected) and Primordial Ooze, which is the substance that gives the monsters their scare power. The random Bag O' Calories increases health, while mailboxes provide tips and information vital to the player's success. Nerves and items may be hidden, but can be discovered by searching in and around boxes and other objects. Mike and Sulley try to get a job at Monsters, Inc. by going to Scare Island in order to train to become top scarers. Scaring human children serves the purpose of generating energy for the monsters' society. As explored in the movie, human children are believed to be highly dangerous, toxic, even. This is the cause for the game's setting being a simulation. Neither Mike nor Sulley are voiced by their original voice actors Billy Crystal and John Goodman respectively. However, Henry Waternoose, Randall, Roz and Ms. Flint are. Information about the game was first released in August 2001 on the gaming website GameSpot.", "A prequel, titled \"Monsters University\", was released on June 21, 2013. John Goodman, Billy Crystal, and Steve Buscemi reprised their roles of Sulley, Mike, and Randall, while Dan Scanlon directed the film. The prequel's plot focuses on Sulley and Mike's studies at Monsters University, where they start off as rivals but soon become best friends. An animated short, \"Mike's New Car\", was made by Pixar in 2002 in which the two main characters have assorted misadventures with a car Mike has just bought. This film was not screened in theaters, but is included with all home video releases of \"Monsters, Inc.\", and on Pixar's Dedicated Shorts DVD. In August 2002, a manga version of \"Monsters, Inc.\" was made by Hiromi Yamafuji and distributed in Kodansha's \"Comic Bon Bon\" magazine in Japan; the manga was published in English by Tokyopop until it went out of print. A series of video games, including a multi-platform video game were created based on the film. The video games included \"Monsters, Inc.\", \"Monsters, Inc. Scream Team\" and \"Monsters, Inc. Scream Arena\". A game titled \"Monsters, Inc. Run\" was released on the App Store for iPhone, iPod Touch, and iPad on December 13, 2012.", "James Patrick \"Sulley\" Sullivan (voiced by John Goodman in the film series, Brian Cummings in \"Monsters, Inc.: The Video Game\", Joel McCrary in \"Disney Infinity\" and \"Disney Infinity 3.0\", Christopher Swindle in \"Kingdom Hearts III\") is a bear-like turquoise-furred male monster with horns, purple spots, razor-sharp claws on his hands, furry talons for feet, a theropod-like tail, spikes running down his back and shark-like fangs. Even though he excels at scaring children, he is kindhearted, thoughtful and affects a relaxed, amiable personality. In the film's beginning, he is \"The Best Scarer\" for several months running.", "Monsters, Inc. is a 2001 American computer-animated buddy comedy film produced by Pixar Animation Studios and distributed by Walt Disney Pictures. Featuring the voices of John Goodman, Billy Crystal, Steve Buscemi, James Coburn, and Jennifer Tilly, the film was directed by Pete Docter in his directorial debut, and executive produced by John Lasseter and Andrew Stanton. The film centers on two monsters \u2013 James P. \"Sulley\" Sullivan and his one-eyed partner and best friend Mike Wazowski \u2013 employed at the titular energy-producing factory Monsters, Inc, which generates power by scaring human children. The monster world believes that children are toxic, and when a small child enters the factory, Sulley and Mike must return her home before it is too late.", "In November 2000, early in the production of \"Monsters, Inc.\", Pixar packed up and moved for the second time since its Lucasfilm years. The company's approximately 500 employees had become spread among three buildings, separated by a busy highway. The company moved from Point Richmond to a much bigger campus in Emeryville, co-designed by Lasseter and Steve Jobs. In production, \"Monsters Inc.\" differed from earlier Pixar features, as every main character in this movie had its own lead animator \u2013 John Kahrs on Sulley, Andrew Gordon on Mike, and Dave DeVan on Boo. Kahrs found that the \"bearlike quality\" of Goodman's voice provided an exceptionally good fit with the character. He faced a difficult challenge, however, in dealing with Sulley's sheer mass; traditionally, animators conveyed a figure's heaviness by giving it a slower, more belabored movement, but Kahrs was concerned that such an approach to a central character would give the film a \"sluggish\" feel. Like Goodman, Kahrs came to think of Sulley as a football player, one whose athleticism enabled him to move quickly in spite of his size. To help the animators with Sulley and other large monsters, Pixar arranged for Rodger Kram, a University of California, Berkeley expert on the locomotion of heavy mammals, to lecture on the subject.", "Bill Murray was considered for the voice role of James P. \"Sulley\" Sullivan. He screen tested for the role and was interested, but when Pete Docter was unable to make contact with him, he took it as a \"no\". The voice role of Sulley went to John Goodman, the longtime co-star of the comedy series \"Roseanne\" and a regular in the films of the Coen brothers. Goodman interpreted the character to himself as the monster equivalent of a National Football League player. \"He's like a seasoned lineman in the tenth year of his career,\" he said at the time. \"He is totally dedicated and a total pro.\" Billy Crystal, having regretted turning down the part of Buzz Lightyear years prior, accepted that of Mike Wazowski, Sulley's one-eyed best friend and scare assistant. The casting of Steve Buscemi as Randall, Sulley's rival, saw a reunion between himself and John Goodman; they had previously worked together on \"The Big Lebowski\" and \"Barton Fink\".", "English voice actors reprising their roles from previous games include Haley Joel Osment as Sora, Bill Farmer as Goofy, Tony Anselmo as Donald Duck, and Alyson Stoner as Kairi. Many of the voice actors for the Disney and Pixar characters reprise their roles from their respective films. These include: Josh Gad as Olaf; Kristen Bell as Anna; Idina Menzel as Elsa; Jonathan Groff as Kristoff; Zachary Levi as Flynn Rider; Donna Murphy as Mother Gothel; John Ratzenberger as Hamm; Wallace Shawn as Rex; Tate Donovan as Hercules; Kevin McNally as Gibbs; Susan Egan as Megara; Ryan Potter as Hiro; Jamie Chung as Go Go; Scott Adsit as Baymax; Genesis Rodriguez as Honey Lemon; Khary Payton as Wasabi (who reprises the role from \"\" replacing Damon Wayans Jr. from the film); and T.J. Miller as Fred. They are joined by Carlos Alazraqui as Mike Wazowski (who reprises the role from other video games, replacing Billy Crystal) and Christopher Swindle as Sulley (replacing John Goodman). \"Kingdom Hearts III\" also has full voice acting in optional dialogue moments outside of cut scenes, which is a first for the series.", "Mike is portrayed as a comedian at the Walt Disney World attraction, Monsters, Inc. Laugh Floor. Mike is not only known for his humor, but also his intelligence. He has made appearances in other Pixar movies, such as \"Finding Nemo\", \"Cars\", \"WALL-E\", and \"Toy Story 3\". Randall Boggs (voiced by Steve Buscemi in the film series, J.P. Manoux in the video game, Peter Kelamis in the \"Disney Infinity\" video game series) is a Cianfa Donati-inspired purple, impatient, multi-legged lizard monster with an ability to change skin color and blend in completely with his surroundings. He is Sulley's nemesis and Mike's arch-rival and former best friend.", "Henry James Waternoose (voiced by James Coburn) is a five-eyed humanoid crustacean-like monster in \"Monsters, Inc.\" He is the CEO of Monsters, Inc. The company has been in Waternoose's family for 3 generations as he had inherited the company from his father at the age of 142. Waternoose also previously had a mentoring relationship with Sulley. Waternoose is first seen where he reminds Thaddeus Bile and the other trainees about the dangers of a human child getting into Monstropolis after Thaddeus left the door opened. He has been impressed with Sulley's progress. However, Mr. Waternoose is distraught to learn that the impending energy crisis is increasing, due to many children being desensitized and being unable to be scared by monsters, which might put the company on the verge of being shut down.", "Boo (voiced by Mary Gibbs) is a 2-year-old human girl who becomes Sulley and Mike's friend. During Randall's secret late-night work on the Scare Floor, Boo gets into the factory and Sulley tries various attempts to get her back, eventually placing her inside a duffle bag. When Sulley brings this up with Mike at Harryhausen's, Boo gets out and frightens the patrons; the CDA have to \"decontaminate\" the restaurant. While Mike and Sulley are at home, they discover that the girl is not toxic after all. Sulley quickly grows attached to the girl and names her \"Boo\". The next day, they smuggle her into the factory disguised as a child of one of Sulley's relatives, and Mike attempts to return her through her door. Randall tries to kidnap Boo, but kidnaps Mike by mistake. When Boo was brought into the simulation room after Mike and Sulley escaped from Randall, she ended up severely frightened by Sulley's roar. When Mike and Sulley tried to return Boo to her home, Mr. Waternoose had Mike and Sulley exiled to the Himalayas. Sulley returns to the factory and rescues Boo from Randall's Scream Extractor. During the chase through the large storage vault, Boo's laughter ends up causing all the doors to operate. Eventually, Boo gets over being afraid of Randall, and helps to defeat him. Sulley and Mike are able to access Boo's door, but Mr. Waternoose and the CDA send it back to the Scare Floor. Mike distracts the CDA, while Sulley escapes with Boo and her door, although Waternoose follows. The CDA's undercover leader is revealed to be Roz, and she allows Sulley and Mike 5 minutes to return Boo to her world. Once Sulley and Mike have returned Boo to her room, her door is put through the shredder. Sometime later, Mike takes Sulley aside revealing he has rebuilt Boo's door requiring only one more piece which Sulley had taken as a memento, the one taped to his clipboard. Sulley inserts the last piece, reactivates the door and enters to find Boo there."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[905, 917], [72, 84], [43, 55], [171, 183], [500, 510], [240, 252], [924, 943], [295, 308], [34, 46], [0, 25]], "rd_topk": 5}, "test_2038": {"question": "Who wrote trust and believe by Keyshia Cole", "answer": ["Keyshia Cole", "Guordan Banks", "Jessyca Wilson", "Darhyl Camper , Jr."], "prediction": ["Guordan Banks", "Keyshia Cole.", "Guordan Banks and Jessyca Wilson", "Jessyca Wilson", "Lauren Daigle", "The Righterz", "Marilyn Martin", "Tamyra Gray", "Catherine Pierce", "Brian Higgins"], "score": [82.71527099609375, 81.5931625366211, 81.17903900146484, 76.70787048339844, 76.69429016113281, 74.40288543701172, 73.75985717773438, 72.46471405029297, 71.22225189208984, 71.2086181640625], "title": [["Trust and Believe"], ["Trust and Believe"], ["Trust and Believe"], ["Trust and Believe"], ["Trust in You"], ["Woman to Woman (Keyshia Cole album)"], ["Trust, Love, Pray"], ["I Believe (Fantasia song)"], ["Believe in Me (The Pierces song)"], ["Believe (Cher song)"]], "evidence": ["\"Trust and Believe\" is a song by Grammy-nominated R&B singer/songwriter Keyshia Cole. It serves as the second single from her long anticipated, fifth studio album, \"Woman to Woman\" and the follow up to the top 10 hit, \"Enough of No Love\". It debuted on October 2, 2012 on Cole's official website and was first released for digital download on October 22, 2012. \"Trust and Believe is the second single from Cole's album \"Woman to Woman\". It was co-written by Guordan Banks and Jessyca Wilson of R&B duo The Righterz. It was produced by Grammy-nominated producer and songwriter DJ Camper. It premiered on Tuesday, October 2, 2012. The heartfelt ballad reflects upon Cole's position, with being cheated on by her ex-lover with her best friend. With it being one of Cole's favorites on the album, it shows the true premise of the album to help ladies with men who have done them wrong.", "\"Trust and Believe\" is a song by Grammy-nominated R&B singer/songwriter Keyshia Cole. It serves as the second single from her long anticipated, fifth studio album, \"Woman to Woman\" and the follow up to the top 10 hit, \"Enough of No Love\". It debuted on October 2, 2012 on Cole's official website and was first released for digital download on October 22, 2012. \"Trust and Believe is the second single from Cole's album \"Woman to Woman\". It was co-written by Guordan Banks and Jessyca Wilson of R&B duo The Righterz. It was produced by Grammy-nominated producer and songwriter DJ Camper. It premiered on Tuesday, October 2, 2012. The heartfelt ballad reflects upon Cole's position, with being cheated on by her ex-lover with her best friend. With it being one of Cole's favorites on the album, it shows the true premise of the album to help ladies with men who have done them wrong.", "\"Trust and Believe\" is a song by Grammy-nominated R&B singer/songwriter Keyshia Cole. It serves as the second single from her long anticipated, fifth studio album, \"Woman to Woman\" and the follow up to the top 10 hit, \"Enough of No Love\". It debuted on October 2, 2012 on Cole's official website and was first released for digital download on October 22, 2012. \"Trust and Believe is the second single from Cole's album \"Woman to Woman\". It was co-written by Guordan Banks and Jessyca Wilson of R&B duo The Righterz. It was produced by Grammy-nominated producer and songwriter DJ Camper. It premiered on Tuesday, October 2, 2012. The heartfelt ballad reflects upon Cole's position, with being cheated on by her ex-lover with her best friend. With it being one of Cole's favorites on the album, it shows the true premise of the album to help ladies with men who have done them wrong.", "\"Trust and Believe\" is a song by Grammy-nominated R&B singer/songwriter Keyshia Cole. It serves as the second single from her long anticipated, fifth studio album, \"Woman to Woman\" and the follow up to the top 10 hit, \"Enough of No Love\". It debuted on October 2, 2012 on Cole's official website and was first released for digital download on October 22, 2012. \"Trust and Believe is the second single from Cole's album \"Woman to Woman\". It was co-written by Guordan Banks and Jessyca Wilson of R&B duo The Righterz. It was produced by Grammy-nominated producer and songwriter DJ Camper. It premiered on Tuesday, October 2, 2012. The heartfelt ballad reflects upon Cole's position, with being cheated on by her ex-lover with her best friend. With it being one of Cole's favorites on the album, it shows the true premise of the album to help ladies with men who have done them wrong.", "\"Trust In You\" is a song by American contemporary Christian music singer-songwriter Lauren Daigle. It was released as the third single from her debut studio album, \"How Can It Be\", on January 22, 2016. The song became her first Hot Christian Songs No. 1, staying there for eighteen weeks. A music video for \"Trust In You\" was released on April 15, 2015. The video features Daigle singing with other men in the background playing instruments.", "\"Trust and Believe\" is the album's second single. It is a heartfelt ballad written by R&B duo The Righterz and was produced by DJ Camper. \"Trust and Believe\" was released for digital download on October 22, 2012 and again on November 13, 2012. On October 24, it was ranked the number one added song to Urban radio of the week. Cole announced on her official Twitter account that \"I Choose You\" will be the album's third single. It was sent to urban radio on August 23, 2013. The music video for the song was filmed in August 2013. It was directed by Ethan Lader. The video displays a story of Cole in love with two men, but unable to let one go. Cole appeared on BET's \"106 & Park\" on October 2, 2013 for the world premiere of the video. The video premiered on VEVO later that evening.", "Trust, Love, Pray is the fourth studio album from American singer Marilyn Martin, released independently in 2012. The album is a collection of original songs of trials, temptations, love, and faith. All of the album's songs were written solely by Martin, except \"In the Arms of God\" which was written by Eric Kaz and Martin. The album was produced, engineered and mixed by Martin's husband Greg Droman. Hank Williams mastered the album at Mastermix, Nashville. The song \"Every Way And Always\" received airplay on Christian and Praise and Worship stations.", "\"I Believe\" is the debut single released by singer and \"American Idol\" season 3 winner, Fantasia Barrino. The song significantly helped Fantasia rise to fame. The song was co-written by former \"American Idol\" contestant Tamyra Gray and was released on June 29, 2004. \"I Believe\" peaked at number one on US \"Billboard\" Hot 100 and Canadian Singles Chart and number four on Australian ARIA Singles Chart. It was included on her debut album \"Free Yourself\", released on November 23, 2004. Fantasia sang \"I Believe\" on the third season finale of \"American Idol\" as her last performance within the competition. Diana DeGarmo, the runner up of American Idol Season 3, sang the song first, also on the finale, for her first performance of the night. The judges unanimously acclaimed Fantasia the winner of season 3, a prediction that came true when she was crowned American Idol the following evening. An ecstatic and tearful Fantasia performed her new single \"I Believe\" minutes after the announcement. DeGarmo's performance was also well received by the judges.", "\"Believe in Me\" is a song by American duo The Pierces, released in 2014 as the second single from their fifth studio album \"Creation\". It was written by Catherine Pierce and produced by Christian Langdon. A music video was released on 18 February to promote the single. The song reached No. 66 on the UK Singles Chart and No. 59 on the Scottish Singles Chart. Upon release, Matt Collar of AllMusic described the song as \"buoyant '60s girl group-infused\", which \"retain[s] all of the duo's bright and infectious lyricism\". David Smyth of the \"London Evening Standard\" commented that the song \"sounds like a golden hit and a startling departure from the Gothic Americana that made their name\". Molloy Woodcraft of \"The Guardian\" considered the song \"catchy\" and highlighted the \"Florence-esque bass drum and handclaps\". Lisa-Marie Ferla of The Arts Desk commented that the song was a \"gorgeous drive-time radio ballad in the best of ways, all hand claps and huge choruses\". Lauren James of Contactmusic.com noted the song's use of \"handclaps, high production and heart-rending harmony\". Andy Baber of \"MusicOMH\" wrote: \"While tracks such as \"Believe in Me\" and \"Elements\" are perfectly serviceable, neither is likely to stick in the mind long after it comes to an end.\"", "\"Believe\" is a song recorded by the American singer Cher for her twenty-second album, \"Believe\" (1998), released by Warner Bros. Records. It was released as the lead single from the album on October 19, 1998. It was written by Brian Higgins, Stuart McLennen, Paul Barry, Steven Torch, Matthew Gray and Timothy Powell , Cher had also written part., and was produced by Mark Taylor and Brian Rawling. \"Believe\" departed from Cher's pop rock style of the time for an upbeat dance-pop style. It featured a pioneering use of the audio processor software Auto-Tune as a vocal effect, which became known as the \"Cher effect\". The lyrics describe empowerment and self-sufficiency after a painful breakup."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[458, 471], [72, 85], [458, 490], [476, 490], [84, 97], [94, 106], [66, 80], [220, 231], [153, 169], [227, 240]], "rd_topk": 1}, "test_2039": {"question": "Who dies at the end of den of thieves", "answer": ["Levi", "Bosco", "Merrimen"], "prediction": ["Richie", "Renzi", "Tony Rex", "Sirius", "Cassandra", "Dobby", "Jacob", "Dab", "Merrimen", "Seth"], "score": [80.49259948730469, 80.42021179199219, 80.35921478271484, 80.0209732055664, 79.67671203613281, 79.2470703125, 79.05233764648438, 78.60875701904297, 78.580810546875, 78.56565856933594], "title": [["From Dusk till Dawn"], ["The Burglars"], ["Exodus (Bertagna novel)"], ["Harry Potter and the Order of the Phoenix"], ["Den (film)"], ["Harry Potter and the Deathly Hallows"], ["From the Corner of His Eye"], ["The Alchymist's Cat"], ["Den of Thieves (film)"], ["The Regulators (novel)"]], "evidence": ["The bar employees reveal themselves as vampires and kill most of the patrons. Richie is bitten by a stripper and dies; only Seth, Jacob, Kate, Scott, a biker named Sex Machine, and Frost, a Vietnam veteran, survive. The others are reborn as vampires, including Richie, forcing the survivors to kill them all. When an army of vampires, in bat form, assembles outside, the survivors lock themselves in, but Sex Machine is bitten, becomes a vampire, and bites Frost and Jacob. Frost throws Sex Machine through the door, allowing the vampires to enter while Frost turns into a vampire.", "The thieves plan to leave the country immediately on a merchant ship. However when they arrive at the dock they discover the ship is undergoing repairs and will not be ready for five days. They hide the money, split up, and agree to wait out the delay. Zacharia reappears, having decided to find and keep the emeralds himself. Azard falls in love with Lena. Zacharia identifies the thieves and kills Renzi, seeing to it that Ralph seems guilty of the crime. Azad narrowly escapes the police with Lena, but he soon discovers that she is conspiring with Zacharia.", "Together, they organise an escape plan that involves David crashing the Noos with a 20th-century virus, allowing Mara to free the slaves and then leave the city unnoticed. The only catch is that David would not be able to leave with Mara, with whom he has fallen in love, because he must stay to begin a rebellion against the unfair New World. While executing her plan, Mara fatally stabs Tony Rex, a man she believes is a spy, with an ancient bone dagger, and then rescues Gorbals, Wing and all the people chosen in the Pickings, who have become slaves. They slide down air vents into the Netherworld and board a supply ship. They break free of the city walls, also saving the people in the refugee boat camp and the Netherworld. The boats are programmed to Greenland, a place that is thought to have risen high above the water like a cork. Fox also slides down the air vents, to begin his rebellion outside the reach of his grandfather. The book finishes with Mara wondering how far people will go to save themselves, and if Caledon was right to save a special few. The book ends with the hope that the refugees will reach safety in Greenland. A screenplay for this book is currently under way. The movie adaptation of \"Exodus\" is not yet scheduled for release.", "Luna, Ron, Ginny, and Neville join them in the forest and all six fly to the Ministry on thestrals, expecting to find and rescue Sirius. Once in the Department of Mysteries, Harry realises that his vision was falsely planted by Voldemort; however, he finds a glass sphere that bears his and the Dark Lord's names. Death Eaters led by Lucius Malfoy attack in order to capture the sphere, which is a recording of a prophecy concerning Harry and Lord Voldemort. The prophecy is revealed to be the object Voldemort has been trying to obtain for the whole year, because Voldemort believes he missed something when he first heard the prophecy. Lucius explains that only the subjects of the prophecies, in this case, Harry or Voldemort, can safely remove them from the shelves. During a heated fight, Neville accidentally kicks and smashes the prophecy. Harry and his friends, soon joined by members of the Order, enter a battle with the Death Eaters, during which Bellatrix Lestrange kills Sirius. Voldemort himself arrives to kill Harry, but Dumbledore shows up and calmly engages in a ferocious duel with Voldemort, eventually reaching to a stalemate. Unable to kill Dumbledore, Voldemort tries to possess Harry in an attempt to get Dumbledore to kill Harry. Harry fights off the possession, and Voldemort escapes just as Cornelius Fudge appears, finally faced with first-hand evidence that Voldemort has truly returned.", "It is revealed that Den is storing them under a church where he works as a priest. Den uses the captive's secrets to turn one against the other. But Cassandra takes all the physical and mental abuse and throws it back at Den with all the strength and stamina she can muster. As the final day approaches the body count rises: Den has cut off Lolita's finger because she was pointing at him. She dies from an infection, although Den was kind enough to cauterize the wound with a soldering iron. With Milton's sexual orientation and affair with Lolita exposed, Den manipulates Steven into stabbing and killing Milton with a crucifix-knife. He offers to let Steven get away with the killing, but recants, and when Steven attacks him in anger, Den beats him to death. The final scene has Cassandra verbally attacking the Bible and Den's beliefs. She calls out several mistakes that are written in this holy text and, thereby proves, if there is a God, he had no hand in the making of this religious manuscript. Den, after supposedly killing a few children, returns to kill Cassandra. He stabs her in the chest with the crucifix-knife. He taunts her about pulling the knife out so she can kill him. She doesn't and he feels that this is proof of the \"no atheist in foxholes\" theory. As he turns to leave, Cassandra removes the knife and tosses it at Den. The knife skewers his head. He removes the knife and rushes to kill her, but convulses and dies on her. Cassandra is unable to escape and dies. Their final death tableau forms the Piet\u00e0 position.", "The trio are captured by Snatchers and taken to Malfoy Manor, where Bellatrix Lestrange tortures Hermione to learn how the three acquired the sword, which she had believed was in her vault at Gringotts. With the help of Dobby the house-elf they escape along with fellow prisoners Luna Lovegood, Mr. Ollivander, Dean Thomas, and the goblin Griphook. During the escape, Peter Pettigrew is strangled by his own silver hand after Harry reminds him of the debt he owes him; Harry overpowers Draco Malfoy and steals his wand; and Dobby is killed by Bellatrix. Bellatrix's anger in interrogating Hermione suggests to Harry some exceptional object is in her vault, and when questioned, Griphook confirms a gold cup is indeed in her vault. With Griphook's help, they break into the vault at Gringotts, retrieve the cup, and escape on a dragon, but in the chaos Griphook steals the Sword of Gryffindor from them. Harry has another vision of Voldemort and sees that he now understands their plan, and intends to make his remaining horcruxes even safer. The vision also confirms the unidentified horcrux is at Hogwarts.", "Thomas Vanadium was a detective and previously a man of the cloth. He had a talent to flick quarters through a hole or gap in dimensions and into another. He was sent into a coma which lasted for 8 months after Junior killed a nurse and tried to kill Vanadium. Vanadium suffered numerous facial injuries as a result of this, thus making his face severely distorted. However, he chooses to keep his face in this condition as a way of tormenting Junior, spending much of the book after this making Junior believe he is a ghost back for revenge. Unlike Angel, Barty cannot extend his power to Vanadium so he can walk in the rain without getting wet. Near the end of the story, he helps Angel, Grace, and Celestina move into the Lampions' house. After finding Junior's former lawyer's severed head in a cooler at his and Paul's house, Vanadium arrives just in time to distract Junior enough for Angel to push her evil father into another world. Eventually, after Jacob is killed by Junior, he moves into Jacob's apartment on the Lampion's property (by then Thomas had become good friends with the Lampions, the Whites, and the Isaacsons). A few years before Thomas eventually died from old age, he once again became a man of the cloth.", "The Bubonic plague spreads throughout London. Although Imelza and Dab escape from Spittle, Imelza is beaten to death by a mob. Will's friend Molly saves Dab from near death. When Dab returns home, Spittle kills him during an experiment. Jupiter and Leech battle over who is heir to the black arts. After Spittle creates an immortality potion, he creates the Philosopher's Stone. Later, he succumbs to the plague and dies. Jupiter uses the potion on Spittle to resurrect him. Jupiter then discovers Dab's body, so he drinks the potion himself and turns on his master, whom he kills in a fire. Leech betrays Jupiter and leaves him to die in the fire, inheriting his brother's magic powers. Leech then falls into the fire himself. It is revealed later that the cat rescued by Will is Leech. Having drunk the immortality potion, Leech convinces a rat kept by Spittle to take him to the sewers. Leech takes his brother's name and title as his own: \"Jupiter, Lord of All\". The book gradually weaves both story lines together. Both the Great Plague and the Great Fire of London appear in the story.", "Merrimen, Bosco, and Levi try to make their escape with the money bags from the waste truck but hit a traffic jam and are blocked. Nick's team spots them and attempt to shoot them as the robbers try to escape. A shootout occurs initiated by Merrimen, killing one of Nick's men. Levi and Bosco are eventually shot dead, but Merrimen gets away. Nick chases and shoots Merrimen, wounding him. Merrimen raises an empty gun to Nick, forcing Nick to shoot him. As Merrimen lies on the ground dying, Nick kneels and consoles him. When Nick inspects Merrimen's SUV, he only finds bags with shredded paper; he also finds that Donnie has escaped custody.", "Audrey leads everyone across the street into her house, where she reveals that she used laxatives to purge Tak from Seth\u2019s body in the form of smoke. Cammie Reed kills Seth and mortally wounds Audrey as Tak tries to sneak back into the boy\u2019s body. Tak\u2019s attention is diverted to her, and it flies into Cammie\u2019s body. But, she cannot hold up to Tak the way that Seth could, and her body is destroyed as a result of the possession. Tak leaves her in the form of smoke and dissipates in the wind. A short epilogue in the form of a letter reveals that Seth\u2019s and Audrey\u2019s ghosts have taken up residence at the meadow from Audrey\u2019s sanctuary, and live there happily. In the novel's epilogue, a letter written by a woman on her honeymoon to her friend mentions one of Stephen King's earlier works, \"The Shining\". \"You're the only person I know who's read not just one copy of \"The Shining\" to tatters, but two!\" \"...although I don't suppose it's much like Stephen King's Overlook...\" As of August 14, 2014, there have been discussions about turning \"The Regulators\" into a TV series, per King's Twitter account."], "em_top1": false, "em_top10": true, "f1_top1": 0, "f1_top10": 1.0, "se_pos": [[78, 84], [400, 405], [389, 397], [984, 990], [1453, 1462], [524, 529], [959, 964], [179, 182], [458, 466], [168, 172]], "rd_topk": 1}, "test_2040": {"question": "Who holds the most home runs in MLB history", "answer": ["Barry Bonds"], "prediction": ["Barry Bonds", "Barry Bonds", "Bonds", "Barry Bonds", "Barry Bonds", "762", "Mark McGwire", "Outfielder Babe Ruth", "Babe Ruth", "Barry Bonds"], "score": [86.11272430419922, 81.58695983886719, 81.48209381103516, 80.52018737792969, 78.15534973144531, 77.41157531738281, 76.55807495117188, 76.50504302978516, 76.42951965332031, 76.32939910888672], "title": [["List of Major League Baseball career home run leaders"], ["List of Major League Baseball annual home run leaders"], ["List of Major League Baseball career home run leaders"], ["Home run"], ["Hitting for the cycle"], ["List of Major League Baseball career home run leaders"], ["At bats per home run"], ["List of New York Yankees team records"], ["List of New York Yankees team records"], ["500 home run club"]], "evidence": ["This is a list of the top 300 Major League Baseball leaders in home runs hit. In the sport of baseball, a home run is a hit in which the batter scores by circling all the bases and reaching home plate in one play, without the benefit of a fielding error. This can be accomplished either by hitting the ball out of play while it is still in fair territory (a conventional home run), or by an inside-the-park home run. Barry Bonds holds the Major League Baseball home run record with 762. He passed Hank Aaron, who is currently second with 755, on August 7, 2007. The only other player to have hit 700 or more is Babe Ruth with 714. Alex Rodriguez (696), Willie Mays (660), Albert Pujols (633), Ken Griffey, Jr. (630), Jim Thome (612), and Sammy Sosa (609) are the only other players to have hit 600 or more.", "Ruth set the Major League Baseball single-season home run record four times, first at 29 (1919), then 54 (1920), 59 (1921), and finally 60 (1927). Ruth's 1920 and 1921 seasons are tied for the widest margin of victory for a home run champion as he topped the next highest total by 35 home runs in each season. The single season mark of 60 stood for 34 years until Roger Maris hit 61 home runs in 1961. Maris' mark was broken 37 years later by both Mark McGwire and Sammy Sosa during the 1998 home run record chase, with McGwire ultimately setting the mark at 70. Barry Bonds, who also has the most career home runs, set the current single season record of 73 in 2001. The 1998 and 2001 seasons each had 4 players hit 50 or more home runs \u2013 Greg Vaughn, Ken Griffey, Jr., Sosa, and McGwire in 1998 and Alex Rodriguez, Luis Gonzalez, Sosa, and Bonds in 2001. A player has hit 50 or more home runs 42 times, 25 times since 1990. The lowest home run total to lead a major league was four, recorded in the NL by Lip Pike in 1877 and Paul Hines in 1878.", "This is a list of the top 300 Major League Baseball leaders in home runs hit. In the sport of baseball, a home run is a hit in which the batter scores by circling all the bases and reaching home plate in one play, without the benefit of a fielding error. This can be accomplished either by hitting the ball out of play while it is still in fair territory (a conventional home run), or by an inside-the-park home run. Barry Bonds holds the Major League Baseball home run record with 762. He passed Hank Aaron, who is currently second with 755, on August 7, 2007. The only other player to have hit 700 or more is Babe Ruth with 714. Alex Rodriguez (696), Willie Mays (660), Albert Pujols (633), Ken Griffey, Jr. (630), Jim Thome (612), and Sammy Sosa (609) are the only other players to have hit 600 or more.", "In Major League Baseball, the career record is 762, held by Barry Bonds, who broke Hank Aaron's record on August 7, 2007, when he hit his 756th home run at AT&T Park off pitcher Mike Bacsik. Only eight other major league players have hit as many as 600: Hank Aaron (755), Babe Ruth (714), Alex Rodriguez (696), Willie Mays (660), Albert Pujols (633), Ken Griffey, Jr. (630), Jim Thome (612), and Sammy Sosa (609). The single season record is 73, set by Barry Bonds in 2001. Other notable single season records were achieved by Babe Ruth who hit 60 in 1927, Roger Maris, with 61 home runs in 1961, and Mark McGwire, who hit 70 in 1998.", "A home run is a hit in which the batter reaches home plate, scoring a run on the same play without being put out, and without the benefit of a fielding error. Most often in modern baseball, this occurs when the batter hits the ball over the outfield wall in fair territory. Home-run hitters are often likely to be larger, slower players due to their strength, and may not be fast enough to complete the triple. The MLB single-season and all-time leader in home runs is Barry Bonds, who hit 73 home runs in the 2001 season and notched 762 in his 22-season career. Bonds never hit for the cycle. Of MLB leaders in career home runs, the highest ranking player with a cycle is Alex Rodriguez (fourth all-time; retired in 2016 with 696 home runs), who hit for the cycle on June 5, 1997. Home runs can also occur on a batted ball that does not leave the field of play; this is called an inside-the-park home run. Inside-the-park home runs are rare, and no player has hit one as part of a cycle since 1943.", "This is a list of the top 300 Major League Baseball leaders in home runs hit. In the sport of baseball, a home run is a hit in which the batter scores by circling all the bases and reaching home plate in one play, without the benefit of a fielding error. This can be accomplished either by hitting the ball out of play while it is still in fair territory (a conventional home run), or by an inside-the-park home run. Barry Bonds holds the Major League Baseball home run record with 762. He passed Hank Aaron, who is currently second with 755, on August 7, 2007. The only other player to have hit 700 or more is Babe Ruth with 714. Alex Rodriguez (696), Willie Mays (660), Albert Pujols (633), Ken Griffey, Jr. (630), Jim Thome (612), and Sammy Sosa (609) are the only other players to have hit 600 or more.", "In baseball statistics, at bats per home run (AB/HR) is a way to measure how frequently a batter hits a home run. It is determined by dividing the number of at bats by the number of home runs hit. Mark McGwire possesses the MLB record for this statistic with a career ratio of 10.61 at bats per home run and Babe Ruth is second, with 11.76 at bats per home run. Kyle Schwarber has the best current career ratio with 13.82 at bats per home run. Giancarlo Stanton, with 14.33 at bats per home run, was the previous leader among active players.", "Outfielder Babe Ruth holds the most franchise records, with 16, including career home runs, and career and single-season batting average and on-base percentage. Shortstop Derek Jeter has the second-most records among hitters, with eight. Jeter's marks include the records for career hits, singles, doubles, and stolen bases. Among pitchers, Whitey Ford has the most Yankees records with five, all of which are career totals. These include games won, games started, and innings pitched. Several Yankees hold AL and MLB records. Ruth has MLB single-season records for extra-base hits and total bases, and holds four other AL single-season records. Outfielder Joe DiMaggio had a 56-game hitting streak in the 1941 season, which remains an MLB record. Jack Chesbro holds three AL records that he set in 1904: games won, games started, and complete games.", "Outfielder Babe Ruth holds the most franchise records, with 16, including career home runs, and career and single-season batting average and on-base percentage. Shortstop Derek Jeter has the second-most records among hitters, with eight. Jeter's marks include the records for career hits, singles, doubles, and stolen bases. Among pitchers, Whitey Ford has the most Yankees records with five, all of which are career totals. These include games won, games started, and innings pitched. Several Yankees hold AL and MLB records. Ruth has MLB single-season records for extra-base hits and total bases, and holds four other AL single-season records. Outfielder Joe DiMaggio had a 56-game hitting streak in the 1941 season, which remains an MLB record. Jack Chesbro holds three AL records that he set in 1904: games won, games started, and complete games.", "In Major League Baseball (MLB), the 500 home run club is a group of batters who have hit 500 or more regular-season home runs in their careers. On August 11, 1929, Babe Ruth became the first member of the club. Ruth ended his career with 714 home runs, a record which stood from 1935 until Hank Aaron surpassed it in 1974. Aaron's ultimate career total, 755, remained the record until Barry Bonds set the current mark of 762 during the 2007 season. Twenty-seven players are members of the 500 home run club. Ted Williams (.344) holds the highest batting average among the club members while Harmon Killebrew (.256) holds the lowest."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[417, 428], [563, 574], [423, 428], [60, 71], [469, 480], [482, 485], [197, 209], [0, 20], [11, 20], [385, 396]], "rd_topk": 5}, "test_2041": {"question": "Who abandoned traditional harmony and created the Twelve-Tone system for composition", "answer": ["Arnold Schoenberg"], "prediction": ["Arnold Schoenberg", "Schoenberg", "Austrian composer Arnold Schoenberg", "Arnold Schoenberg", "Austrian composer Arnold Schoenberg", "Arnold Schoenberg's", "Arnold Schoenberg", "Peter Schat", "Peter Schat", "RHM Bosanquet."], "score": [88.91914367675781, 88.05252075195312, 87.85094451904297, 87.84558868408203, 87.57500457763672, 87.29791259765625, 85.80915832519531, 85.79769897460938, 85.10883331298828, 84.90724182128906], "title": [["Twelve-tone technique"], ["Post-tonal music theory"], ["Twelve-tone technique"], ["Twelve-tone technique"], ["Twelve-tone technique"], ["Tone row"], ["Chamber music"], ["Tone Clock"], ["Tone Clock"], ["22 equal temperament"]], "evidence": ["Invented by Austrian composer Arnold Schoenberg in 1921 and first described privately to his associates in 1923, the method was used during the next twenty years almost exclusively by the composers of the Second Viennese School\u2014Alban Berg, Anton Webern, Hanns Eisler and Schoenberg himself. The twelve tone technique was preceded by \"freely\" atonal pieces of 1908\u20131923 which, though \"free\", often have as an \"integrative element ... a minute intervallic cell\" which in addition to expansion may be transformed as with a tone row, and in which individual notes may \"function as pivotal elements, to permit overlapping statements of a basic cell or the linking of two or more basic cells\". The twelve-tone technique was also preceded by \"nondodecaphonic serial composition\" used independently in the works of Alexander Scriabin, Igor Stravinsky, B\u00e9la Bart\u00f3k, Carl Ruggles, and others. Oliver Neighbour argues that Bart\u00f3k was \"the first composer to use a group of twelve notes consciously for a structural purpose\", in 1908 with the third of his fourteen bagatelles. \"Essentially, Schoenberg and Hauer systematized and defined for their own dodecaphonic purposes a pervasive technical feature of 'modern' musical practice, the ostinato\". Additionally, John Covach argues that the strict distinction between the two, emphasized by authors including Perle, is overemphasized:", "Compositional applications of these theories are numerous, but in the present context of \"Post-tonal\" music the most important is \"Serialism\". In this system, certain notes are chosen then written in an order e.g. E-F-C-B-G-F. (Usually there is no repetition, but this is not always observed.) These notes are then used as the basis for a composition by playing them in the original order, in reverse order (Retrograde), in \"upside down\" order (Inversion i.e. upward intervals now go down, and vice versa), or both (Retrograde Inversion or \"Reversion\" [Stravinsky's term]), and then transposed up or down. Chords can also be formed out of the \"Series\" and these can be treated to similar techniques. Schoenberg used these methods in what has become known as Twelve-tone technique. In this, all unique twelve notes of the musical scale are played once and once only in a specified order. The serial techniques described above are then applied. Later composers, such as Jean Barraqu\u00e9 and Pierre Boulez, sought to unify pitch and rhythm by organising the elements into sets of twelve, which resulted in what became known as \"Total Serialism\". See also Formula composition which describes techniques used by Karlheinz Stockhausen.", "Invented by Austrian composer Arnold Schoenberg in 1921 and first described privately to his associates in 1923, the method was used during the next twenty years almost exclusively by the composers of the Second Viennese School\u2014Alban Berg, Anton Webern, Hanns Eisler and Schoenberg himself. The twelve tone technique was preceded by \"freely\" atonal pieces of 1908\u20131923 which, though \"free\", often have as an \"integrative element ... a minute intervallic cell\" which in addition to expansion may be transformed as with a tone row, and in which individual notes may \"function as pivotal elements, to permit overlapping statements of a basic cell or the linking of two or more basic cells\". The twelve-tone technique was also preceded by \"nondodecaphonic serial composition\" used independently in the works of Alexander Scriabin, Igor Stravinsky, B\u00e9la Bart\u00f3k, Carl Ruggles, and others. Oliver Neighbour argues that Bart\u00f3k was \"the first composer to use a group of twelve notes consciously for a structural purpose\", in 1908 with the third of his fourteen bagatelles. \"Essentially, Schoenberg and Hauer systematized and defined for their own dodecaphonic purposes a pervasive technical feature of 'modern' musical practice, the ostinato\". Additionally, John Covach argues that the strict distinction between the two, emphasized by authors including Perle, is overemphasized:", "The twelve-tone technique\u2014also known as dodecaphony, twelve-tone serialism, and (in British usage) twelve-note composition\u2014is a method of musical composition devised by Austrian composer Arnold Schoenberg (1874\u20131951) and associated with the \"Second Viennese School\" composers, who were the primary users of the technique in the first decades of its existence. The technique is a means of ensuring that all 12 notes of the chromatic scale are sounded as often as one another in a piece of music while preventing the emphasis of any one note through the use of tone rows, orderings of the 12 pitch classes. All 12 notes are thus given more or less equal importance, and the music avoids being in a key. Over time, the technique increased greatly in popularity and eventually became widely influential on 20th-century composers. Many important composers who had originally not subscribed to or even actively opposed the technique, such as Aaron Copland and Igor Stravinsky, eventually adopted it in their music.", "The twelve-tone technique\u2014also known as dodecaphony, twelve-tone serialism, and (in British usage) twelve-note composition\u2014is a method of musical composition devised by Austrian composer Arnold Schoenberg (1874\u20131951) and associated with the \"Second Viennese School\" composers, who were the primary users of the technique in the first decades of its existence. The technique is a means of ensuring that all 12 notes of the chromatic scale are sounded as often as one another in a piece of music while preventing the emphasis of any one note through the use of tone rows, orderings of the 12 pitch classes. All 12 notes are thus given more or less equal importance, and the music avoids being in a key. Over time, the technique increased greatly in popularity and eventually became widely influential on 20th-century composers. Many important composers who had originally not subscribed to or even actively opposed the technique, such as Aaron Copland and Igor Stravinsky, eventually adopted it in their music.", "In music, a tone row or note row ( or '), also series or set\"', is a non-repetitive ordering of a set of pitch-classes, typically of the twelve notes in musical set theory of the chromatic scale, though both larger and smaller sets are sometimes found. Tone rows are the basis of Arnold Schoenberg's twelve-tone technique and most types of serial music. Tone rows were widely used in 20th-century contemporary music, e.g. Dmitri Shostakovich's use of twelve-tone rows, \"without dodecaphonic transformations\", though one has been identified in the A minor prelude from book II of \"The Well-Tempered Clavier\" (1742) by J. S. Bach, and by the late eighteenth century was a well-established technique, found in works such as Mozart's C major String Quartet, K. 157 (1772), String Quartet in E-flat major, K. 428, String Quintet in G minor, K. 516 (1790), and the Symphony in G minor, K. 550 (1788). Beethoven also used the technique but, on the whole, \"Mozart seems to have employed serial technique far more often than Beethoven\". Hans Keller claims that Schoenberg was aware of this serial practice in the classical period, and that \"Schoenberg repressed his knowledge of classical serialism because it would have injured his narcissism.\"", "A second direction in the search for a new tonality was twelve-tone serialism. Arnold Schoenberg developed the twelve-tone method of composition as an alternative to the structure provided by the diatonic system. His method entails building a piece using a series of the twelve notes of the chromatic scale, permuting it and superimposing it on itself to create the composition. Schoenberg did not arrive immediately at the serial method. His first chamber work, the string sextet Verkl\u00e4rte Nacht, was mostly a late German romantic work, though it was bold in its use of modulations. The first work that was frankly atonal was the second string quartet; the last movement of this quartet, which includes a soprano, has no key signature. Schoenberg further explored atonality with \"Pierrot Lunaire\", for singer, flute or piccolo, clarinet, violin, cello and piano. The singer uses a technique called Sprechstimme, halfway between speech and song.", "The Tone Clock, and its related compositional theory Tone-Clock Theory, is a post-tonal music composition technique, developed by composers Peter Schat and Jenny McLeod. Music written using tone-clock theory features a high economy of musical intervals within a generally chromatic musical language. This is because tone-clock theory encourages the composer to generate all their harmonic and melodic material from a limited number of intervallic configurations (called 'Intervallic Prime Forms', or IPFs, in tone-clock terminology). Tone-clock theory is also concerned with the way that the three-note pitch-class sets (trichords or 'triads' in tone-clock terminology) can be shown to underlie larger sets, and considers these triads as a fundamental unit in the harmonic world of any piece. Because there are twelve possible triadic prime forms, Schat called them the 'hours', and imagined them arrayed in a clock face, with the smallest hour (012 or 1-1 in IPF notation) in the 1 o'clock position, and the largest hour (048 or 4-4 in IPF notation) in the 12 o'clock position. A notable feature of Tone-Clock Theory is 'tone-clock steering': transposing and/or inverting hours so that each note of the chromatic aggregate is generated once and once only.", "The term 'tone clock' (\"toonklok\" in Dutch) was originally coined by Dutch composer Peter Schat, in reference to a technique he had developed of creating pitch 'fields' by transposing and inverting a trichord so that all twelve pitch-classes would be created once and once only. Schat discovered that it was possible to achieve a trichordally partitioned aggregate from all twelve trichords, with the exception of the diminished triad (036 or 3-10 in Forte's pitch-class set theory). Schat called the 12 trichords the 'hours', and they became central to the harmonic organization in a number of his works. He created a 'zodiac' of the hours, which shows in graphical form the symmetrical patterns created by the tone-clock steerings of the hours. (Note that Hour X is substituted with its tetrachord, the diminished seventh, which can be tone-clock steered).", "In music, 22 equal temperament, called 22-tet, 22-edo, or 22-et, is the tempered scale derived by dividing the octave into 22 equal steps (equal frequency ratios). Each step represents a frequency ratio of , or 54.55 cents (). The idea of dividing the octave into 22 steps of equal size seems to have originated with nineteenth-century music theorist RHM Bosanquet. Inspired by the division of the octave into 22 unequal parts in the music theory of India, Bosanquet noted that an equal division was capable of representing 5-limit music with tolerable accuracy. In this he was followed in the twentieth century by theorist Jos\u00e9 W\u00fcrschmidt, who noted it as a possible next step after 19 equal temperament, and J. Murray Barbour in his survey of tuning history, \"Tuning and Temperament\". Contemporary advocates of 22 equal temperament include music theorist Paul Erlich."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[30, 47], [700, 710], [12, 47], [187, 204], [169, 204], [280, 299], [79, 96], [140, 151], [84, 95], [351, 365]], "rd_topk": 3}, "test_2042": {"question": "What domain has more individuals than all other domains combined do", "answer": ["the com TLD"], "prediction": ["CYP2D6", "C21orf62", "DRB1", "taxon", "Reality", "Oligogenic inheritance", "Titin", "C3orf62", "Extraversion", "consciousness"], "score": [72.93476867675781, 72.60107421875, 72.09617614746094, 71.8218994140625, 71.7481460571289, 71.56021881103516, 71.46656036376953, 71.07017517089844, 71.038818359375, 71.00003051757812], "title": [["CYP2D6"], ["C21orf62"], ["HLA-DRB3 (gene)"], ["Phylogenetic nomenclature"], ["Reality"], ["Oligogenic inheritance"], ["Titin"], ["C3orf62"], ["Personality changes"], ["Consciousness"]], "evidence": ["CYP2D6 shows the largest phenotypical variability among the CYPs, largely due to genetic polymorphism. The genotype accounts for normal, reduced, and non-existent CYP2D6 function in subjects. Pharmacogenomic tests are now available to identify patients with variations in the CYP2D6 allele and have been shown to have widespread use in clinical practice. The CYP2D6 function in any particular subject may be described as one of the following: A patient's CYP2D6 phenotype is often clinically determined via the administration of debrisoquine (a selective CYP2D6 substrate) and subsequent plasma concentration assay of the debrisoquine metabolite (4-hydroxydebrisoquine).", "The C21orf62 protein in humans has a sequence that is 219 amino acids in length. The primary sequence of C21orf62 in humans has a molecular weight of 24.9 kDa and an isoelectric point of 8. When it's cleavable signal peptide, which spans amino acids 1-19, is removed, it has a molecular weight of 22.8 kDa and an isoelectric point of 7.8. C21orf62 in humans has higher cysteine and lower valine concentrations than expected compared to other human proteins. This trend, as showed in Table 1, is the same for other mammals. It does not, however, occur in taxa other than \"mammalia\".", "The beta chain is approximately 26-28 kDa. It is encoded by 6 exons, exon one encodes the leader peptide, exons 2 and 3 encode the two extracellular domains, exon 4 encodes the transmembrane domain and exon 5 encodes the cytoplasmic tail. Within the DR molecule the beta chain contains all the polymorphisms specifying the peptide binding specificities. Within the DR molecule the beta chain contains all the polymorphisms specifying the peptide binding specificities. Typing for these polymorphisms is routinely done for bone marrow and kidney transplantation. DRB1 is expressed at a level five times higher than its paralogues DRB3, DRB4 and DRB5. DRB1 is present in all individuals. Allelic variants of DRB1 are linked with either none or one of the genes DRB3, DRB4 and DRB5. There are 4 related pseudogenes: DRB2, DRB6, DRB7, DRB8 and DRB9.", "The conflict between phylogenetic and traditional nomenclature reflects differing views of the metaphysics of taxa. For the advocates of phylogenetic nomenclature, a taxon is an individual, an entity that gains and loses attributes as time passes. Just as a person does not become somebody else when his or her properties change through maturation, senility, or more radical changes like amnesia, the loss of a limb, or a change in sex, so a taxon remains the same entity whatever characteristics are gained or lost.", "Reality is the sum or aggregate of all that is real or existent, as opposed to that which is merely imaginary. The term is also used to refer to the ontological status of things, indicating their existence. In physical terms, reality is the totality of the universe, known and unknown. Philosophical questions about the nature of reality or existence or being are considered under the rubric of ontology, which is a major branch of metaphysics in the Western philosophical tradition. Ontological questions also feature in diverse branches of philosophy, including the philosophy of science, philosophy of religion, philosophy of mathematics, and philosophical logic. These include questions about whether only physical objects are real (i.e., Physicalism), whether reality is fundamentally immaterial (e.g., Idealism), whether hypothetical unobservable entities posited by scientific theories exist, whether God exists, whether numbers and other abstract objects exist, and whether possible worlds exist.", "Oligogenic inheritance (Greek \u1f40\u03bb\u03af\u03b3\u03bf\u03c2 \u2013 \"\u1f40ligos\" = few, a little) describes a trait that is influenced by more than one gene. Oligogenic inheritance represents an intermediate between monogenic inheritance in which a trait is determined by a single causative gene, and polygenic inheritance, in which a trait is influenced by many genes and often environmental factors. Historically, many traits were thought to be governed by a single causative gene (in what is deemed monogenic inheritance), however work in genetics revealed that these traits are comparatively rare, and in most cases so-called monogenic traits are predominantly influenced by one gene, but can be mediated by other genes of small effect.", "A number of titin isoforms are produced in different striated muscle tissues as a result of alternative splicing. All but one of these isoforms are in the range of ~27,000 to ~36,000 amino acid residues in length. The exception is the small cardiac novex-3 isoform which is only 5,604 amino acid residues in length. The following table lists the known titin isoforms: Titin is the largest known protein; its human variant consists of 34,350 amino acids, with the molecular weight of the mature \"canonical\" isoform of the protein being approximately 3,816,188.13 Da. Its mouse homologue is even larger, comprising 35,213 amino acids with a MW of 3,906,487.6 Da. It has a theoretical isoelectric point of 6.01. The protein's empirical chemical formula is CHNOS. It has a theoretical instability index (II) of 42.41, classifying the protein as unstable. The protein's in vivo half-life, the time it takes for half of the amount of protein in a cell to break down after its synthesis in the cell, is predicted to be approximately 30 hours (in mammalian reticulocytes).", "C3orf62 is expressed in more than 30 different tissues; highest expression is in whole blood. Specifically, highest expression of C3orf62 is in the following tissues: lung, tonsil, trachea, small intestine, mammary gland, and salivary gland. Through analysis of various microarray studies, C3orf62 is found to have consistently high expression compared to other genes tested in the datasets. C3orf62 has low expression in brain tissues. C3orf62 possess two post-translational modifications, both are phosphorylation sites with locations at amino acid 210 and 224. A natural variant is found at amino acid 110 (Glutamic acid (E)--> Lysine K).", "Therefore, someone is not conscientious all the time, but can be conscientious at work and a lot less so when she is home. This work also suggests that intrapersonal variations on a trait can be even larger than interpersonal variations. Extraversion varies more within a person than across individuals, for example. This work was based on individual self-ratings during the day across a long period of time. This allowed for researchers to assess moment-to-moment and day to day variations on personality attributes.", "Many philosophers have argued that consciousness is a unitary concept that is understood intuitively by the majority of people in spite of the difficulty in defining it. Others, though, have argued that the level of disagreement about the meaning of the word indicates that it either means different things to different people (for instance, the objective versus subjective aspects of consciousness), or else is an umbrella term encompassing a variety of distinct meanings with no simple element in common."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[0, 6], [339, 347], [562, 566], [442, 447], [0, 7], [0, 22], [368, 373], [0, 7], [238, 250], [35, 48]], "rd_topk": 1}, "test_2043": {"question": "Who plays the judge in drop dead diva", "answer": ["Lex Medlin"], "prediction": ["Sally Fields", "Fields", "Wanda Sykes", "Wanda Sykes plays the judge, Amanda Bearse", "Brooke D'Orsay", "Lex Medlin", "Reema Lagoo)", "Rah Digga", "Natalie Hall", "Madeline Hughes Haikala"], "score": [89.35714721679688, 86.39016723632812, 83.59629821777344, 82.33842468261719, 81.0015869140625, 80.947509765625, 80.8353500366211, 79.57532501220703, 78.90465545654297, 78.51311492919922], "title": [["Drop Dead Diva (season 3)"], ["Drop Dead Diva (season 3)"], ["2010 Itawamba County School District prom controversy"], ["2010 Itawamba County School District prom controversy"], ["Drop Dead Diva"], ["Drop Dead Diva (season 4)"], ["Divorce: Not Between Husband and Wife"], ["Black Trash: The Autobiography of Kirk Jones"], ["Drop Dead Diva"], ["Madeline Hughes Haikala"]], "evidence": ["The third season of \"Drop Dead Diva\" premiered on June 19, 2011 and concluded on September 25, 2011, on Lifetime. Season three aired on Sundays at 9:00 pm ET and consisted of 13 episodes. Sally Fields had a guest appearance as the judge for the episode. Grayson nearly marries Vanessa, but she backs out on the day of the wedding. Jane has two relationships during the season that indicate she is trying to move on from Grayson. The first, with Dr. Bill Kendall (Ben Shenkman), ends when he reveals that Jane is one of the several women he is dating and that he is not ready to get serious with any one of them. The second, toward the end of the season, is with a fun-loving new judge named Owen French (Lex Medlin).", "The third season of \"Drop Dead Diva\" premiered on June 19, 2011 and concluded on September 25, 2011, on Lifetime. Season three aired on Sundays at 9:00 pm ET and consisted of 13 episodes. Sally Fields had a guest appearance as the judge for the episode. Grayson nearly marries Vanessa, but she backs out on the day of the wedding. Jane has two relationships during the season that indicate she is trying to move on from Grayson. The first, with Dr. Bill Kendall (Ben Shenkman), ends when he reveals that Jane is one of the several women he is dating and that he is not ready to get serious with any one of them. The second, toward the end of the season, is with a fun-loving new judge named Owen French (Lex Medlin).", "Celebrity blogger Perez Hilton invited McMillen and guests of her choosing to attend at his expense a birthday bash being held for him, and she accepted. When he posted about it on his web site, he wrote that \"she will be treated like a homecoming queen for the day.\" Along with activists Judy Shepard and Lt. Daniel Choi, McMillen was chosen as a Grand Marshal of the 2010 New York City Gay Pride March. The television series \"Drop Dead Diva\" based a season 3 episode on the incident (\"Prom\", aired July 24, 2011). Wanda Sykes plays the judge, Amanda Bearse another judge, and McMillen has a cameo role as a bailiff.", "Celebrity blogger Perez Hilton invited McMillen and guests of her choosing to attend at his expense a birthday bash being held for him, and she accepted. When he posted about it on his web site, he wrote that \"she will be treated like a homecoming queen for the day.\" Along with activists Judy Shepard and Lt. Daniel Choi, McMillen was chosen as a Grand Marshal of the 2010 New York City Gay Pride March. The television series \"Drop Dead Diva\" based a season 3 episode on the incident (\"Prom\", aired July 24, 2011). Wanda Sykes plays the judge, Amanda Bearse another judge, and McMillen has a cameo role as a bailiff.", "Drop Dead Diva is an American legal comedy-drama/fantasy television series that aired on Lifetime from July 12, 2009, to June 22, 2014. The series was created by Josh Berman and produced by Sony Pictures Television. It stars Brooke Elliott as Jane, a plus-sized lawyer whose body is inhabited by the soul of a fashion model. On October 25, 2013, Lifetime renewed the series for a sixth season, which premiered on March 23, 2014, and concluded on June 22, 2014. The series revolves around vapid aspiring model, Deborah \"Deb\" Dobkins (played by Brooke D'Orsay), who is killed in a car crash on the way to an audition for \"The Price Is Right\". As her soul enters the gates of Heaven, she finds herself being judged by a gatekeeper named Fred (Ben Feldman). As a result of her shallowness, Fred declares her a \"zero-zero\", since she has performed zero good deeds and zero bad deeds during her time on Earth. While he is distracted, Deb presses the \"return\" key before Fred can stop her, and is brought back to life in the body of a recently deceased lawyer named Jane Bingum (Elliott), who died protecting her boss, Jay Parker (Josh Stamberg).", "The fourth season of \"Drop Dead Diva\" premiered on June 3, 2012 and concluded on September 9, 2012, on Lifetime. Season four aired Sundays at 9:00 pm ET and consisted of 13 episodes. On September 22, 2011, Lifetime picked up the show for a 4th season featuring 13 episodes, which premiered on June 3, 2012. Lex Medlin who played the recurring role of Judge Owen French, has been upgraded to a series regular in season four. Carter MacIntyre also joined the main cast for season four. He plays the role of Luke Daniels, Jane's new guardian angel. Kim Kardashian will recur as Nikki, Stacy's business partner. Brandy is confirmed to be reprising her role as Elisa Shayne for season four. ", "Though Pranav did not mean what he said, Jackie is shocked and convinces Pranav against it. In another incident that follows, Shyam (Rajendranath Zutshi), a drug addict and a resident of the apartment building in which Pranav resides, commits suicide due to a failed relationship. Pranav understands from a depressed old man that suicide is \"freedom from all worries.\" These incidents create an indelible mark in the mind of Pranav, who thereafter threatens Jackie that he would commit suicide if he was not getting a divorce from his parents. Jackie conveys the seriousness to his parents. Sidharth and Renuka plan come home early in turns, but they still do not address the actual problems of Pranav, who wants to share a lot with his parents. But as a result of the professional demands, Sidharth and Renuka start quarreling with each other for not sticking on to their plan. Now Pranav decides to campaign for the divorce with all his heart. Jackie is unable to convince Pranav this time and agrees to take up the case on Pranav's behalf for granting the separation. As an outcome the Judge (Reema Lagoo) instructs the government to devise a new penal code to handle the case where the kid himself can file a complaint against his parents. The new penal code is created, and the final verdict by the Judge becomes the climax of the film.", "Kirk questions his life in the song \"Oh My God\". God answers all his questions. The song reflects what is happening in the head of Kirk Jones. Kirk is arrested. On one of the highlights of the album \"State Vs Kirk Jones\" Rah Digga plays the role of judge, Canibus as the prosecutor, Redman as the defence attorney, as well as Scarred 4 Life, Lord Superb and Guess Who rapping as witnesses. All verses show us the whole court trial. Kirk Jones found guilty. Omar Epps playing the role of Kirk's conscience again tells us what is happening in Kirk's head. This time, Kirk reflects on what brought him to prison and the people he left behind. Kirk orders a telephone conversation with his younger brother in \"Baby Brother\", in which Kirk tries to dissuade his brother from the route he has chosen. Kirk's girlfriend visits him in prison. While he thought she faithful to him, she has other news. Sticky finds out she's cheating on him. At the end Kirk meets his lawyer, who informs Sticky that his appeal for clemency denied, and it will take time to reconsider his case.", "Deb struggles to learn more about her inherited life, learning lessons about self-esteem and personal acceptance. Eventually, the real Jane Bingum (played by Natalie Hall) reappears in another person's body after having pressed the return key, leading Deb to finally reveal the truth to Grayson, now one of Jane's closest friends. Grayson, after grieving and moving on from Deb's passing, becomes conflicted, but finally accepts Deb in her new body, saying that he wants her to be her and no one else.", "Madeline Hughes Haikala (born November 4, 1964) is a United States District Judge of the United States District Court for the Northern District of Alabama. Haikala was born Madeline Clair Hughes in 1964, in New Orleans, Louisiana. She received her Bachelor of Arts degree in 1986 from Williams College. She received her Juris Doctor in 1989 from Tulane University Law School, graduating Order of the Coif. She worked in private practice from 1989 until 2011, serving at the law firm of Lightfoot, Franklin & White LLC in Birmingham, Alabama, handling a broad range of commercial litigation at the trial and appellate levels, before state and federal courts. From 1998 to 2005, she taught Appellate Law at Cumberland School of Law as an adjunct professor. She served as a United States Magistrate Judge in the Northern District of Alabama from 2012 to 2013."], "em_top1": false, "em_top10": true, "f1_top1": 0, "f1_top10": 1.0, "se_pos": [[188, 200], [194, 200], [516, 527], [516, 558], [543, 557], [307, 317], [1096, 1108], [221, 230], [158, 170], [0, 23]], "rd_topk": 1}, "test_2044": {"question": "Who played the music producer in pitch perfect 2", "answer": ["Keegan - Michael Key"], "prediction": ["Flula Borg", "Rebel Wilson", "Shelley Regner, as well as Skylar Astin", "Mark Mothersbaugh", "Christopher Shepard", "Shelley Regner", "Elizabeth Banks and John Higgins", "Max Martin", "Adam DeVine,", "Matthias Gohl"], "score": [83.47416687011719, 79.28443908691406, 79.11479187011719, 79.00283813476562, 78.40174865722656, 77.40570831298828, 77.04313659667969, 76.9762954711914, 76.90164184570312, 76.70196533203125], "title": [["Pitch Perfect 2"], ["Pitch Perfect 2"], ["Pitch Perfect 2"], ["Pitch Perfect 2"], ["Pitch Perfect 2"], ["Pitch Perfect 3"], ["Pitch Perfect"], ["Love Me like You Do"], ["Anna Kendrick"], ["Matthias Gohl"]], "evidence": ["Anna Kendrick and Wilson returned to the cast early in 2014 to play the characters they originated in the first film. Brittany Snow reprised her character. On April 24, Chrissie Fit was added to the cast. On May 1, Hailee Steinfeld was added to the cast, playing a new member of the Barden Bellas. On May 5, Adam DeVine was reported to return in the film. On May 14, Katey Sagal was added to the cast, playing Steinfeld's character's mother. On May 29, Flula Borg was added to the cast. He played the leader of a European a cappella group, Das Sound Machine, that competed with the Bellas. It was confirmed on June 18, 2014 that Christopher Shepard was added to the cast. It was confirmed on June 19, 2014 that Pentatonix would play the role of a rival group to the Barden Bellas. It was later confirmed that The Filharmonic from season 4 of \"The Sing Off\" would make a cameo appearance as a rival group from the Philippines. On August 24, 2014 it was announced that Penn Masala, the all-male Hindi a cappella group from director Elizabeth Banks's and producer Max Handelman's alma mater The University of Pennsylvania, would be featured as a team from Southeast Asia. On June 25, Birgitte Hjort S\u00f8rensen was confirmed added to the cast.", "Pitch Perfect 2 is a 2015 American musical comedy film directed and produced by Elizabeth Banks and written by Kay Cannon. It is a sequel to the 2012 film \"Pitch Perfect\" and the second installment in the \"Pitch Perfect\" film series. The film centers on the fictional Barden University Bellas, an all-female a cappella singing group, who try to beat out the German national team in a world singing championship. The film features an ensemble cast, including Anna Kendrick, Rebel Wilson, Hailee Steinfeld, Brittany Snow, Hana Mae Lee, Alexis Knapp, Ester Dean, Chrissie Fit, Kelley Jakle, and Shelley Regner, as well as Skylar Astin, Ben Platt, Adam DeVine, John Michael Higgins, and Banks all reprising their roles. It was released in the United States on May 15, 2015 by Universal Pictures.", "Pitch Perfect 2 is a 2015 American musical comedy film directed and produced by Elizabeth Banks and written by Kay Cannon. It is a sequel to the 2012 film \"Pitch Perfect\" and the second installment in the \"Pitch Perfect\" film series. The film centers on the fictional Barden University Bellas, an all-female a cappella singing group, who try to beat out the German national team in a world singing championship. The film features an ensemble cast, including Anna Kendrick, Rebel Wilson, Hailee Steinfeld, Brittany Snow, Hana Mae Lee, Alexis Knapp, Ester Dean, Chrissie Fit, Kelley Jakle, and Shelley Regner, as well as Skylar Astin, Ben Platt, Adam DeVine, John Michael Higgins, and Banks all reprising their roles. It was released in the United States on May 15, 2015 by Universal Pictures.", "On May 21, 2014, principal photography began at Louisiana State University (LSU) campus in Baton Rouge. On December 3, 2014, Mark Mothersbaugh was hired to compose the music for the film. The official soundtrack was released on May 12, 2015. The special edition soundtrack was later released on August 8, 2015. The original album debuted at number one on the \"Billboard\" 200, earning 107,000 album-equivalent units (92,000 copies of traditional sales) in the week ending May 17, 2015. The film was released on May 7, 2015 in Australia and New Zealand, and May 15 in the United States and Canada.", "Anna Kendrick and Wilson returned to the cast early in 2014 to play the characters they originated in the first film. Brittany Snow reprised her character. On April 24, Chrissie Fit was added to the cast. On May 1, Hailee Steinfeld was added to the cast, playing a new member of the Barden Bellas. On May 5, Adam DeVine was reported to return in the film. On May 14, Katey Sagal was added to the cast, playing Steinfeld's character's mother. On May 29, Flula Borg was added to the cast. He played the leader of a European a cappella group, Das Sound Machine, that competed with the Bellas. It was confirmed on June 18, 2014 that Christopher Shepard was added to the cast. It was confirmed on June 19, 2014 that Pentatonix would play the role of a rival group to the Barden Bellas. It was later confirmed that The Filharmonic from season 4 of \"The Sing Off\" would make a cameo appearance as a rival group from the Philippines. On August 24, 2014 it was announced that Penn Masala, the all-male Hindi a cappella group from director Elizabeth Banks's and producer Max Handelman's alma mater The University of Pennsylvania, would be featured as a team from Southeast Asia. On June 25, Birgitte Hjort S\u00f8rensen was confirmed added to the cast.", "On June 10, 2015, a third film was officially confirmed, and Kay Cannon was set to return to write the script. On June 15, 2015, it was announced that Kendrick and Wilson would both reprise their roles, and on July 28, 2015, Brittany Snow signed on to return. Paul Brooks again produced for Gold Circle Films, along with Max Handelman and Banks for Brownstone Productions. On October 27, 2015, Banks was officially announced to return as director for the film, though she exited in that capacity on June 3, 2016. On September 1, 2016, Trish Sie was confirmed to direct the film. On December 13, 2016, it was reported that Ruby Rose was in talks to join the film, while Anna Camp also signed on to return for the sequel. Cannon wrote the script with later drafts by Mike White and Dana Fox; White would eventually receive screenwriting credits alongside Cannon. On January 5, 2017, a table read occurred, with Ester Dean, Hana Mae Lee, Chrissie Fit, Kelley Jakle, and Shelley Regner also being confirmed to reprise their roles, and singer Andy Allo joining as Charity, a rival in a group opposing the Bellas. While it was revealed by vocal director Deke Sharon that Alexis Knapp is returning, she wasn't spotted during the first month of filming, leading fans to show concerns that she might not be returning at all. However, on February 6, she posted a photo on Instagram, confirming her return, and was on set the following day, filming a short cameo performance.", "In December 2012, Skylar Astin revealed that he and Rebel Wilson had meetings with Universal about a potential sequel. In April 2013, it was confirmed that a sequel would be released in 2015. Elizabeth Banks would direct the sequel, with Kay Cannon returning as screenwriter. Brooks would produce for Gold Circle Films with Banks and Max Handelman producing for Brownstone Productions. Kay Cannon would co-produce with Gold Circle's Jeff Levine. Anna Kendrick, Skylar Astin, Rebel Wilson, Anna Camp, Brittany Snow, Ben Platt, Adam DeVine, Ester Dean, Alexis Knapp, Kelley Jakle, Shelley Regner, Wanetah Walmsley, Elizabeth Banks and John Higgins would all reprise their roles in the sequel. Additionally, Hailee Steinfeld and Chrissie Fit would join the cast as Emily and Flo who are the new Barden Bellas while Katey Sagal would join as Emily's mother and German YouTube star Flula Borg would appear as Pieter Kramer.", "\"Love Me like You Do\" was acclaimed by music critics. Samantha Grossman of \"Time\" called the song \"sultry\" and dubbed it a \"solid addition to the \"Fifty Shades\" soundtrack.\" Christina Garibaldi of MTV News also called it \"sultry\" and \"soft\", adding that \"we can totally picture it being played during any steamy scene.\" Ryan Reed of \"Rolling Stone\" opined that its \"results are grandiose, considering the film's sensual subject matter.\" Jim Farber of the \"NY Daily News\" praised her \"little-girl-lost voice\", noting that \"Goulding sounds sweet even when she's courting danger. The music, likewise, goes for a high gloss take on romance, recalling the heavily echoed beats and dense synthesizers of a Phil Collins ballad from the '80s.\" Robbie Daw of Idolator described \"Love Me like You Do\" as \"a sweeping power ballad that finds Goulding delivering soft, understated vocals over producer Max Martin's swelling bed of synths.\" Lucas Villa of AXS commended Goulding for \"masterfully tread[ing] between delicacy and power in her performance\", calling the song \"intimately magnificent\". Glenn Gamboa of \"Newsday\" called it \"sweet, catchy, near-perfect rom-com fare\".", "In 2012, Kendrick featured opposite Chace Crawford as part of the ensemble cast of \"What to Expect When You're Expecting\", loosely based on the pregnancy guide of the same name. Also that year, she lent her voice to the stop-motion animated film \"ParaNorman\", starred in the commercially successful crime drama \"End of Watch\", playing the love interest of Jake Gyllenhaal's character, and appeared in Robert Redford's political thriller \"The Company You Keep\". Kendrick's most successful film of 2012 was the musical comedy \"Pitch Perfect\" (2012), loosely based on the non-fiction book \"Pitch Perfect: The Quest for Collegiate A Cappella Glory\". Kendrick played the protagonist of the film, leading an ensemble cast including Skylar Astin, Rebel Wilson, Adam DeVine, Anna Camp, Brittany Snow, and more. She played Beca Mitchell, a rebellious college freshman who joins an a cappella group called the Barden Bellas and finds that her more modern approach to music clashes with the traditional approach of the group's leader. The film emerged as a major commercial success and received mostly positive reviews from critics, who called Kendrick's performance \"splendid\", saying that she \"hits just the right note between pithy and chummy.\"", "Matthias Gohl is a Swiss musical producer/director/supervisor/composer of film scores and stage productions. He produced most of Elliot Goldenthal's film scores (starting in 1987 with the score to Pet Semetary) as well others. Two scores that he has produced have won an Oscar: Elliot Goldenthal's \"Frida\" and John Corigliano's \"The Red Violin\". He worked for almost twenty years as musical director for Carly Simon, appearing on albums, tours, soundtracks and on television. He was nominated for an Emmy in 2005 in the category \"Outstanding Music Direction\" for \"\" and for an Grammy in 2008 in the category \"Best Compilation Soundtrack Album for Motion Picture, Television or Other Visual Media\" for \"Across the Universe\" (shared with T-Bone Burnett and Elliot Goldenthal). Gohl also used variations of his first name (like Teese or Tisse) for onscreen credits."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[453, 463], [473, 485], [592, 631], [125, 142], [629, 648], [967, 981], [613, 645], [889, 899], [754, 766], [0, 13]], "rd_topk": 1}, "test_2045": {"question": "Who plays Lois'S dad on family guy", "answer": ["MacFarlane"], "prediction": ["Michael Ironside", "Charles Durning", "Carter Pewterschmidt.", "Michael \"Mike\" Henry", "Alex Borstein),", "Seth MacFarlane", "Michael Ironside", "Seth MacFarlane)", "MacFarlane.", "Tim Conway"], "score": [84.04020690917969, 83.87750244140625, 83.38883972167969, 83.01893615722656, 82.02894592285156, 81.8930435180664, 81.85929107666016, 81.61012268066406, 81.542724609375, 81.28570556640625], "title": [["Lois Lane (Smallville)"], ["List of Family Guy cast members"], ["Family Guy"], ["Mike Henry (voice actor)"], ["List of Family Guy episodes"], ["List of Family Guy cast members"], ["Smallville (season 10)"], ["List of Family Guy characters"], ["Family Guy (season 1)"], ["List of Married... with Children episodes"]], "evidence": ["Lois Lane makes her first appearance in season four's \"Crusade\" when she comes to Smallville investigating the death of her cousin Chloe Sullivan (Allison Mack). While investigating Chloe's death with Clark Kent (Tom Welling) in \"Gone\", the pair uncover the truth that Chloe is still alive, but in witness protection until Lionel Luthor's trial, the man she is testifying against with evidence that he orchestrated the death of his own parents. Lionel (John Glover) discovers the truth and sends someone to kill her, but Lois and Clark stop the would-be killer, allowing Chloe to testify. Before Lois can leave Smallville, her father (Michael Ironside) informs her that she failed to achieve all of her high school credits and that he has enrolled her in Smallville High so that she can complete her twelfth-grade year. Staying with the Kents, Lois begins attending Smallville High. In \"Fa\u03c2ade\", Chloe convinces her to become a reporter for the \"Torch\" in an effort to help Lois earn some of her remaining credits. With Lex Luthor's (Michael Rosenbaum) help in the episode \"Devoted\", Clark manages to get Lois her remaining credits ahead of schedule so that she can attend Metropolis University, and vacate his bedroom.", "The recurring guest voices include Adam Carolla as Death, Patrick Stewart as Susie Swanson, Scott Grimes as Kevin Swanson and Sanaa Lathan as Donna Tubbs Brown. Previous recurring guests included Phyllis Diller in three episodes as Peter's Mother, Thelma, and Charles Durning as Peter's father, Francis. Both characters have since died, but Durning returned once to play Francis as a ghost. Early in the show's run, Fred Willard and Jane Lynch had a recurring role as a family of nudists. James Woods as James Woods.", "The case was settled out of court in 2010 with undisclosed terms. Seth MacFarlane voices three of the show's main characters: Peter Griffin, Brian Griffin, and Stewie Griffin. Since MacFarlane had a strong vision for these characters, he chose to voice them himself, believing it would be easier than for someone else to attempt it. MacFarlane drew inspiration for the voice of Peter from a security guard he overheard talking while attending the Rhode Island School of Design. Stewie's voice was based on the voice of English actor Rex Harrison, especially his performance in the 1964 musical drama film \"My Fair Lady\". MacFarlane uses his regular speaking voice when playing Brian. MacFarlane also provides the voices for various other recurring and one-time-only characters, most prominently those of the Griffins' neighbor Glenn Quagmire, news anchor Tom Tucker, and Lois' father, Carter Pewterschmidt.", "Michael \"Mike\" Henry (born November 7, 1965) is an American voice actor, writer, producer, and comedian. He is known for his work on the animated TV series \"Family Guy\" (1999\u2013present), where he writes and produces episodes along with voicing Cleveland Brown, Herbert, Bruce, and Consuela. Henry is also known for co-creating and starring in the spin-off, \"The Cleveland Show\" (2009\u20132013) and for his recurring role as Dann in the television series, \"The Orville\". Henry and his younger brother Patrick were born to artist parents and raised in Richmond, Virginia. His parents divorced when he was six years old and he was primarily raised by his mother. Although money was tight, he was awarded a scholarship and attended the nearby preparatory Collegiate School. Henry graduated from Washington and Lee University (1988) where he earned his B.A. in history and served as class president his sophomore-senior years. Although interested in comedy, Mike never believed he could make a career of it so instead opted for more \u201cbusiness stuff.\u201d", "\"Family Guy\" is an American animated television sitcom created by Seth MacFarlane for the Fox Broadcasting Company. The series centers on the dysfunctional Griffin family, which consists of father Peter (MacFarlane), mother Lois (Alex Borstein), daughter Meg (Lacey Chabert in episodes 1\u20139, then Mila Kunis in \"Da Boom\" onwards), son Chris (Seth Green), baby Stewie (MacFarlane) and Brian (MacFarlane), the family dog. The show is set in the fictional town of Quahog, Rhode Island, and lampoons American culture, often in the form of cutaway gags, and tangential vignettes.", "From seasons 1 to 4, \"Family Guy\" had four main cast members. Since season 5, there have been five main cast members. The casting of Meg Griffin changed after season 1. Seth MacFarlane voices three of the show's main characters: Peter Griffin, Brian Griffin, and Stewie Griffin. MacFarlane chose to voice these characters himself, believing it would be easier to portray the voices he had already envisioned than for someone else to attempt it. MacFarlane drew inspiration for the voice of Peter from a security guard he overheard talking while attending the Rhode Island School of Design. Stewie's voice was based on the voice of English actor Rex Harrison, especially his performance in the 1964 musical drama film \"My Fair Lady\". MacFarlane uses his own voice while portraying Brian.", "James Marsters was confirmed to be returning for the series' 200th episode. Marsters first appeared as Brainiac/Milton Fine in season five and again in seasons seven. This time, Marsters will be portraying Brainiac 5, the version of Brainiac from the future that the Legion of Super-Heroes created after removing the original version of Brainiac from Chloe's body in the season eight episode \"Legion\". In addition, both Michael Shanks and Jessica Parker Kennedy will return as Hawkman/Carter Hall and Plastique, respectively, in the second episode of season ten. Hawkman made a brief appearance in the season nine finale, while Plastique was last seen in season eight. The return of Carter Hall means a deeper look into who that character is, while seeing a \"more human side\" to him than previously seen. On August 11, it was announced that Michael Ironside and Peyton List would be returning for a mid-October episode. Ironside previously portrayed Lois's father, General Sam Lane; while List played Lois's sister, Lucy. Both characters were last seen in separate season four episodes. On September 7, 2010, it was revealed that Alan Ritchson would reprise the role of Arthur Curry/Aquaman in a November episode. Ritchson described his character's return as \"darker\" and less \"bubble-gummy\" than previously seen on the show.", "Brian Griffin (voiced by Seth MacFarlane) is the family's anthropomorphic talking white Labrador Retriever and the best friend of both Stewie and Peter. He and Stewie are often at the center of the show's most critically acclaimed episodes, most notably the \"\"Road to...\"\" episodes, where he and Stewie go on road-trips together. Brian is portrayed as an intellectual\u2014a Brown University attendee\u2014who often serves as the family's voice of reason, pointing out how ridiculous Peter's ideas are. He is not-so-secretly in love with Lois and is an unsuccessful, unemployed writer.", "The writing staff included MacFarlane, Chris Sheridan, Neil Goldman, Garrett Donovan, Ricky Blitt, Andrew Gormley, supervising producers Danny Smith and Gary Janetti, co-producers Matt Weitzman and Mike Barker, and voice actor Mike Henry. There were six directors for the seven episodes, with Michael DiMartino directing two. Peter Shin acted as the supervising director for the entire season. Walter Murphey composed the season's music tracks, while Stan Jones edited them. Season one had a cast of four main actors. MacFarlane voiced Peter Griffin, a blue-collar worker and the patriarch of the Griffin family. The family's evil-genius baby Stewie and their anthropromorphic pet dog Brian, were also voiced by MacFarlane. Other members of the family include Peter's responsible but rebellious wife Lois Griffin, voiced by Alex Borstein; their self-loathing goody two-shoes teenage daughter Meg, voiced by Lacey Chabert; and their socially-awkward teenage son Chris, voiced by Seth Green.", "The tenth season had the death of family pet Buck and his subsequent reincarnation into the body of Lucky, the Bundys' next dog. The season also marks the first appearances of Peggy's father Ephraim (played by Tim Conway) and Peggy's mother, who moves in with the Bundys (although she is never seen, only heard). Also, Peg leaves Al and goes on a search for her father. The 11th season was the final season of \"Married... with Children\". Fox moved the show's time slot several times throughout the course of the season, which cost the show ratings. Rising production costs and decreasing viewer shares led to the show's cancellation in April 1997, after the final taping for season 11. Due to this decision, no official \"final\" episode of \"Married... with Children\" was shown. While \"How to Marry a Moron\" was the final episode to be shot, \"Chicago Shoe Exchange\" was the last episode that Fox broadcast. This was the only season to feature teaser scenes before the opening credits, and a few episodes during this season also featured tag scenes just before the closing credits. For this season, the still of Al and Peggy sitting on the couch was dropped from the closing credits, which for this season are shown against a black background and in a separate card format, instead of scrolling. The opening theme was also greatly shortened, dropping the highway scenes taken from \"National Lampoon's Vacation\", and the scene where Al hands every member of his family money. \"Bundymania\" was a three-hour-and-forty-five-minute special airing nine dubbed German episodes of the series. The special included interviews with David Faustino, Christina Applegate, Ted McGinley, dog trainer Steven Ritt, Amanda Bearse, and Ed O'Neill. A. 'Bootsie' is a pseudonym for J. Stanford Parker."], "em_top1": false, "em_top10": true, "f1_top1": 0, "f1_top10": 1.0, "se_pos": [[635, 651], [260, 275], [885, 906], [0, 20], [230, 245], [169, 184], [841, 857], [25, 41], [712, 723], [210, 220]], "rd_topk": 2}, "test_2046": {"question": "What is the number of basic units in the International system of units", "answer": ["seven"], "prediction": ["seven", "seven", "seven", "six", "7", "seven", "22", "seven", "six", "twenty"], "score": [85.49658203125, 85.35829162597656, 85.35216522216797, 84.90975189208984, 84.05711364746094, 84.05084228515625, 84.00665283203125, 82.53345489501953, 81.58179473876953, 81.29092407226562], "title": [["Measurement"], ["Base unit (measurement)"], ["Unit of measurement"], ["History of the metric system"], ["Metric system"], ["International System of Units"], ["SI derived unit"], ["Measurement"], ["Giovanni Giorgi"], ["Metric prefix"]], "evidence": ["The measurement of a property may be categorized by the following criteria: type, magnitude, unit, and uncertainty. They enable unambiguous comparisons between measurements. Measurements most commonly use the International System of Units (SI) as a comparison framework. The system defines seven fundamental units: kilogram, metre, candela, second, ampere, kelvin, and mole. Six of these units are defined without reference to a particular physical object which serves as a standard (artifact-free), while the kilogram is still embodied in an artifact which rests at the headquarters of the International Bureau of Weights and Measures in S\u00e8vres near Paris. Artifact-free definitions fix measurements at an exact value related to a physical constant or other invariable phenomena in nature, in contrast to standard artifacts which are subject to deterioration or destruction. Instead, the measurement unit can only ever change through increased accuracy in determining the value of the constant it is tied to.", "In the International System of Units, there are seven base units: kilogram, metre, candela, second, ampere, kelvin, and mole. There are other relationships between physical quantities that can be expressed by means of fundamental constants, and to some extent it is an arbitrary decision whether to retain the fundamental constant as a quantity with dimensions or simply to define it as unity or a fixed dimensionless number, and reduce the number of explicit fundamental constants by one. For instance, time and distance are related to each other by the speed of light, \"c\", which is a fundamental constant. It is possible to use this relationship to eliminate either the unit of time or that of distance. Similar considerations apply to the Planck constant, \"h\", which relates energy (with dimension expressible in terms of mass, length and time) to frequency (with dimension expressible in terms of time). In theoretical physics it is customary to use such units (natural units) in which and . A similar choice can be applied to the vacuum permittivity or permittivity of free space, \"\u03b5\". A widely used choice, in particular for theoretical physics, is given by the system of Planck units, which are defined by setting . That leaves every physical quantity expressed as a dimensionless number, so it is not surprising that there are also physicists who have cast doubt on the very existence of incompatible fundamental quantities.", "Different systems of units are based on different choices of a set of base units. The most widely used system of units is the International System of Units, or SI. There are seven SI base units. All other SI units can be derived from these base units. For most quantities a unit is necessary to communicate values of that physical quantity. For example, conveying to someone a particular length without using some sort of unit is impossible, because a length cannot be described without a reference used to make sense of the value given.", "The seminal 1875 Treaty of the Metre resulted in the fashioning and distribution of metre and kilogram artefacts, the standards of the future coherent system that became the SI, and the creation of an international body \"Conf\u00e9rence g\u00e9n\u00e9rale des poids et mesures\" or CGPM to oversee systems of weights and measures based on them. In 1960, the CGPM launched the International System of Units (in French the \"Syst\u00e8me international d'unit\u00e9s\" or SI) which had six \"base units\": the metre, kilogram, second, ampere, degree Kelvin (subsequently renamed the \"kelvin\") and candela; as well as 16 further units derived from the base units. A seventh base unit, the mole, and six additional derived units were added in succeeding years through the close of the twentieth century. During this period, the metre was redefined in terms of the speed of light, and the second was redefined in terms of the microwave frequency of a cesium atomic clock. Since the end of the 20th century, an effort has been undertaken to redefine the ampere, kilogram, mole and kelvin in terms of invariant constants of physics.", "The system was promulgated by the General Conference on Weights and Measures (French: \"Conf\u00e9rence g\u00e9n\u00e9rale des poids et mesures\" \u2013 CGPM) in 1960. At that time, the metre was redefined in terms of the wavelength of a spectral line of the krypton-86 atom, and the standard metre artefact from 1889 was retired. Today, the International system of units consists of 7 base units and innumerable coherent derived units including 22 with special names. The last new derived unit, the \"katal\" for catalytic activity, was added in 1999. Some of the base units are now realised in terms of invariant constants of physics. As a consequence, the speed of light has now become an exactly defined constant, and defines the metre as of the distance light travels in a second. The kilogram remains defined by a man-made artefact of platinum-iridium, and it is deteriorating. The range of decimal prefixes has been extended to those for 10, \"yotta\", and 10, \"yocto\", which are unfamiliar because nothing in our everyday lives is that big or that small.", "The system is based on the quantities underlying each of the seven base units of the SI. Other quantities, such as area, pressure, and electrical resistance, are derived from these base quantities by clear non-contradictory equations. The ISQ defines the quantities that are measured with the SI units. The ISQ is defined in the international standard ISO/IEC 80000, and was finalised in 2009 with the publication of ISO 80000-1. Metrologists carefully distinguish between the definition of a unit and its realisation. The definition of each base unit of the SI is drawn up so that it is unique and provides a sound theoretical basis on which the most accurate and reproducible measurements can be made. The realisation of the definition of a unit is the procedure by which the definition may be used to establish the value and associated uncertainty of a quantity of the same kind as the unit. A description of the \"mise en pratique\" of the base units is given in an electronic appendix to the SI Brochure.", "The names of SI derived units, when written in full, are in lowercase. However, the symbols for units named after persons are written with an uppercase initial letter. For example, the symbol for hertz is \"Hz\"; but the symbol for metre is \"m\". The International System of Units assigns special names to 22 derived units, which includes two dimensionless derived units, the radian (rad) and the steradian (sr). Some other units such as the hour, litre, tonne, bar and electronvolt are not SI units, but are widely used in conjunction with SI units. Until 1995, the SI classified the radian and the steradian as \"supplementary units\", but this designation was abandoned and the units were grouped as derived units.", "The International System of Units (abbreviated as SI from the French language name \"Syst\u00e8me International d'Unit\u00e9s\") is the modern revision of the metric system. It is the world's most widely used system of units, both in everyday commerce and in science. The SI was developed in 1960 from the metre-kilogram-second (MKS) system, rather than the centimetre-gram-second (CGS) system, which, in turn, had many variants. During its development the SI also introduced several newly named units that were previously not a part of the metric system. The original SI units for the seven basic physical quantities were:", "In 1935 this was adopted by the International Electrotechnical Commission (IEC) as the \"M.K.S. System of Giorgi\" without specifying which electromagnetic unit would be the fourth fundamental unit. In 1946 the International Committee for Weights and Measures (CIPM) approved a proposal to use the ampere as that unit in a four-dimensional system, the MKSA system. The \"Giorgi system\" was thus the precursor of the International System of Units (SI) adopted in 1960, which was based on six fundamental units: metre, kilogram, second, ampere, kelvin, and candela. The mole was added as a seventh fundamental unit in 1971.", "Decimal multiplicative prefixes have been a feature of all forms of the metric system, with six dating back to the system's introduction in the 1790s. Metric prefixes have even been prepended to non-metric units. The SI prefixes are standardized for use in the International System of Units (SI) by the International Bureau of Weights and Measures (BIPM) in resolutions dating from 1960 to 1991. Since 2009, they have formed part of the International System of Quantities. The BIPM specifies twenty prefixes for the International System of Units (SI)."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[290, 295], [48, 53], [174, 179], [455, 458], [362, 363], [61, 66], [303, 305], [574, 579], [484, 487], [492, 498]], "rd_topk": 5}, "test_2047": {"question": "What is the meaning of Veronica in English", "answer": ["she who brings victory"], "prediction": ["victory", "the veil", "truth", "true image", "true image", "the true image of Jesus", "veil", "true", "true image", "true"], "score": [85.25570678710938, 84.20465850830078, 83.66688537597656, 82.8938980102539, 82.51854705810547, 82.27731323242188, 82.12345886230469, 81.99214935302734, 81.94979858398438, 81.0714340209961], "title": [["Veronica (name)"], ["Saint Veronica"], ["Veil of Veronica"], ["Via Dolorosa"], ["Jesus healing the bleeding woman"], ["Saint Veronica"], ["Saint Veronica"], ["Saint Veronica"], ["Acheiropoieta"], ["Veronica (name)"]], "evidence": ["Veronica (also spelled Veronika or Ver\u00f3nica) is a female given name, the Latin transliteration of the Greek name Berenice, \u0392\u03b5\u03c1\u03b5\u03bd\u03af\u03ba\u03b7. This was the Macedonian form of the Athenian \u03a6\u03b5\u03c1\u03b5\u03bd\u03af\u03ba\u03b7, \"Pheren\u00edk\u0113\", or \u03a6\u03b5\u03c1\u03bf\u03bd\u03af\u03ba\u03b7, \"Pheron\u00edk\u0113\", from \u03c6\u03ad\u03c1\u03b5\u03b9\u03bd, \"ph\u00e9rein\", to bring, and \u03bd\u03af\u03ba\u03b7, \"n\u00edk\u00ea\", \"victory\", i.e. \"she who brings victory\". The Ancient Macedonian form of the name was popularized because of its extensive use as a royal feminine name by the reigning dynasties of the states of the Diadochi of Alexander the Great throughout the Eastern Mediterranean during the Hellenistic age, most notably by the Ptolemies of Egypt and by the Seleucids of Asia. In medieval etymology, Veronica was sometimes wrongly supposed to derive from Latin \"vera\" (true) and Greek \"eikon\" (image). Its popularity in medieval and modern times is based mainly on the importance in Christianity of Saint Veronica and her Veil of Veronica. Pet forms of Veronica include Ronnie and Roni and the German Frony. In Russian, the pet form is Nika (\u041d\u0438\u043a\u0430). \"Veronica\" is a popular name in many countries in the Mediterranean, Eastern Europe, and Latin America, as well as southern Ireland, France, and French-speaking Canada.", "The name \"Veronica\" itself is a Latinisation of Berenice (, \"Berenik\u0113\", with a secondary form \"Beronike\"), a Macedonian name, meaning \"\"bearer of victory\"\". The woman who offered her veil to Jesus was known by this name in the Byzantine East, but in the Latin West the name took a life of its own. As proven by a medieval text, \"Veronica\" was used by the 13th century as a designation for a relic venerated in Rome as the true image of Jesus. Since the Latin word for \"true\" or \"authentic\" happens to be \"vera\", the theory emerged that the name itself is derived from the Latin phrase \"true image\", \"vera icon\" (one Latin word for \"image\" is \"icon\", derived from , \"eikona\"). In the 13th-century text and also in some later sources the term Veronica was used for the veil, not the person, but for centuries it has been better known as the name of the woman.", "On the Via Dolorosa in Jerusalem there is a small chapel, known as the Chapel of the Holy Face. Traditionally, this is regarded as the home of St Veronica and site of the miracle. According to the Catholic Encyclopedia, the name \"Veronica\" is a colloquial portmanteau of the Latin word vera, meaning truth, and Greek icon (eikon), meaning \"image\"; the Veil of Veronica was therefore largely regarded in medieval times as \"the true image\", and the truthful representation of Jesus, preceding the Shroud of Turin.", "A medieval Roman Catholic legend viewed a specific piece of cloth, known as the \"Veil of Veronica\", as having been supernaturally imprinted with Jesus' image, by physical contact with Jesus' face. By metathesis of the Latin words \"vera icon\" (meaning \"true image\") into \"Veronica\", it came to be said that the \"Veil of Veronica\" had gained its image when a \"Saint Veronica\" encountered Jesus, and wiped the sweat from his face with the cloth; no element of this legend is present in the Bible, although the similar \"Image of Edessa\" is mentioned in \"The Epistles of Jesus Christ and Abgarus King of Edessa\", a late piece of New Testament apocrypha. The \"Veil of Veronica\" relates to a pre-Crucifixion image, and is distinct from the post-Crucifixion Holy Face image, often related to the Shroud of Turin.", "Eusebius, writing in the reign of Constantine I says he himself saw a pair of statues in bronze in Panease or Caesarea Philippi (on the Golan Heights in modern terms) of Jesus and the \"haemorrhoissa\", sculpture being at this time an unusual form for the depiction of Jesus. By his description they resembled a sculptural version of the couple as they were shown in a number of paintings in the Catacombs of Rome (see illustration at top). He sees this in terms of ancient traditions of commemorating local notables rather than newer ones of Early Christian art. The statues were placed outside the house of the woman, who came from the city, and was called Veronica (meaning \"true image\"), according to the apocrypha \"Acts of Pilate\" and later tradition, which gave other details of her life.", "The name \"Veronica\" itself is a Latinisation of Berenice (, \"Berenik\u0113\", with a secondary form \"Beronike\"), a Macedonian name, meaning \"\"bearer of victory\"\". The woman who offered her veil to Jesus was known by this name in the Byzantine East, but in the Latin West the name took a life of its own. As proven by a medieval text, \"Veronica\" was used by the 13th century as a designation for a relic venerated in Rome as the true image of Jesus. Since the Latin word for \"true\" or \"authentic\" happens to be \"vera\", the theory emerged that the name itself is derived from the Latin phrase \"true image\", \"vera icon\" (one Latin word for \"image\" is \"icon\", derived from , \"eikona\"). In the 13th-century text and also in some later sources the term Veronica was used for the veil, not the person, but for centuries it has been better known as the name of the woman.", "The name \"Veronica\" itself is a Latinisation of Berenice (, \"Berenik\u0113\", with a secondary form \"Beronike\"), a Macedonian name, meaning \"\"bearer of victory\"\". The woman who offered her veil to Jesus was known by this name in the Byzantine East, but in the Latin West the name took a life of its own. As proven by a medieval text, \"Veronica\" was used by the 13th century as a designation for a relic venerated in Rome as the true image of Jesus. Since the Latin word for \"true\" or \"authentic\" happens to be \"vera\", the theory emerged that the name itself is derived from the Latin phrase \"true image\", \"vera icon\" (one Latin word for \"image\" is \"icon\", derived from , \"eikona\"). In the 13th-century text and also in some later sources the term Veronica was used for the veil, not the person, but for centuries it has been better known as the name of the woman.", "According to the Catholic Encyclopedia, the name \"Veronica\" comes from the Latin \"vera\", meaning \"true\" or \"Truthful\", and the Greek \"eikon\", meaning \"image\"; the Veil of Veronica was therefore largely regarded in medieval times as the \"true image\", the truthful representation of Jesus, preceding the Shroud of Turin. Saint Veronica was mentioned in the reported visions of Jesus by Sister Marie of St Peter, a Carmelite nun who lived in Tours, France, and started the devotion to the Holy Face of Jesus. In 1844, Sister Marie reported that in a vision, she saw Saint Veronica wiping away the spit and mud from the face of Jesus with her veil on the way to Calvary. She said that sacrilegious and blasphemous acts today are adding to the spit and mud that Saint Veronica wiped away that day. According to Sr Marie of St Peter, in her visions Jesus told her that he desired devotion to His Holy Face in reparation for sacrilege and blasphemy. Acts of Reparation to Jesus Christ are thus compared to Saint Veronica wiping the face of Jesus.", "The legend says that Veronica (a name meaning \"true image\") from Jerusalem encountered Jesus along the Via Dolorosa on the way to Calvary. When she paused to wipe the sweat (Latin \"suda\") off his face with her veil, his image was imprinted on the cloth. The event is commemorated by one of the Stations of the Cross. According to legend, Veronica later traveled to Rome to present the cloth to the Roman Emperor Tiberius. Legend has it that it has miraculous properties, being able to quench thirst, restore sight, and sometimes even raise the dead. Recent studies trace the association of the name with the image to the translation of Eastern relics to the West at the time of the Crusades.", "Veronica (also spelled Veronika or Ver\u00f3nica) is a female given name, the Latin transliteration of the Greek name Berenice, \u0392\u03b5\u03c1\u03b5\u03bd\u03af\u03ba\u03b7. This was the Macedonian form of the Athenian \u03a6\u03b5\u03c1\u03b5\u03bd\u03af\u03ba\u03b7, \"Pheren\u00edk\u0113\", or \u03a6\u03b5\u03c1\u03bf\u03bd\u03af\u03ba\u03b7, \"Pheron\u00edk\u0113\", from \u03c6\u03ad\u03c1\u03b5\u03b9\u03bd, \"ph\u00e9rein\", to bring, and \u03bd\u03af\u03ba\u03b7, \"n\u00edk\u00ea\", \"victory\", i.e. \"she who brings victory\". The Ancient Macedonian form of the name was popularized because of its extensive use as a royal feminine name by the reigning dynasties of the states of the Diadochi of Alexander the Great throughout the Eastern Mediterranean during the Hellenistic age, most notably by the Ptolemies of Egypt and by the Seleucids of Asia. In medieval etymology, Veronica was sometimes wrongly supposed to derive from Latin \"vera\" (true) and Greek \"eikon\" (image). Its popularity in medieval and modern times is based mainly on the importance in Christianity of Saint Veronica and her Veil of Veronica. Pet forms of Veronica include Ronnie and Roni and the German Frony. In Russian, the pet form is Nika (\u041d\u0438\u043a\u0430). \"Veronica\" is a popular name in many countries in the Mediterranean, Eastern Europe, and Latin America, as well as southern Ireland, France, and French-speaking Canada."], "em_top1": false, "em_top10": false, "f1_top1": 0.4, "f1_top10": 0.4, "se_pos": [[311, 318], [763, 771], [300, 305], [252, 262], [676, 686], [418, 441], [767, 771], [98, 102], [47, 57], [736, 740]], "rd_topk": 1}, "test_2048": {"question": "When did Krakow become the capital of Poland", "answer": ["1038"], "prediction": ["1038", "103", "from 1038", "1596", "1040", "1079 - 1138", "1079 to 1138", "1079", "2011", "January 1945"], "score": [77.63215637207031, 77.13911437988281, 75.81105041503906, 73.9078369140625, 73.24090576171875, 72.66417694091797, 72.56610107421875, 72.47715759277344, 72.16848754882812, 71.3463134765625], "title": [["History of Krako\u0301w"], ["History of Krako\u0301w"], ["History of Krako\u0301w"], ["Krako\u0301w"], ["Lesser Poland"], ["P\u0142ock"], ["P\u0142ock"], ["P\u0142ock"], ["Language assessment"], ["Lublin"]], "evidence": ["Krak\u00f3w (Cracow) is one of the largest and oldest cities in Poland, with the urban population of 756,441 (2008). Situated on the Vistula river () in the Lesser Poland region, the city dates back to the 7th century. It was the capital of Poland from 1038 to 1596, the capital of the Grand Duchy of Krak\u00f3w from 1846 to 1918, and the capital of Krak\u00f3w Voivodeship from the 14th century to 1999. It is now the capital of the Lesser Poland Voivodeship. The earliest known settlement on the present site of Krak\u00f3w was established on Wawel Hill, and dates back to the 4th century. Legend attributes the town's establishment to the mythical ruler Krakus, who built it above a cave occupied by a ravenous dragon, Smok Wawelski. Many knights unsuccessfully attempted to oust the dragon by force, but instead, Krakus fed it a poisoned lamb, which killed the dragon. The city was free to flourish. Dragon bones, most likely that of mammoth, are displayed at the entrance of the Wawel Cathedral. Before the Polish state had been formed, Krak\u00f3w was the capital of the tribe of Vistulans, subjugated for a short period by Great Moravia. After Great Moravia was destroyed by the Hungarians, Krak\u00f3w became part of the kingdom of Bohemia. The first appearance of the city's name in historical records dates back to 966, when a Sephardi Jewish traveller, Abraham ben Jacob, described Krak\u00f3w as a notable commercial centre under the rule of the then duke of Bohemia (Boleslaus I the Cruel). He also mentioned the baptism of Prince Mieszko I and his status as the first historical ruler of Poland. Towards the end of his reign, Mieszko took Krak\u00f3w from the Bohemians and incorporated it into the holdings of the Piast dynasty.", "Krak\u00f3w (Cracow) is one of the largest and oldest cities in Poland, with the urban population of 756,441 (2008). Situated on the Vistula river () in the Lesser Poland region, the city dates back to the 7th century. It was the capital of Poland from 1038 to 1596, the capital of the Grand Duchy of Krak\u00f3w from 1846 to 1918, and the capital of Krak\u00f3w Voivodeship from the 14th century to 1999. It is now the capital of the Lesser Poland Voivodeship. The earliest known settlement on the present site of Krak\u00f3w was established on Wawel Hill, and dates back to the 4th century. Legend attributes the town's establishment to the mythical ruler Krakus, who built it above a cave occupied by a ravenous dragon, Smok Wawelski. Many knights unsuccessfully attempted to oust the dragon by force, but instead, Krakus fed it a poisoned lamb, which killed the dragon. The city was free to flourish. Dragon bones, most likely that of mammoth, are displayed at the entrance of the Wawel Cathedral. Before the Polish state had been formed, Krak\u00f3w was the capital of the tribe of Vistulans, subjugated for a short period by Great Moravia. After Great Moravia was destroyed by the Hungarians, Krak\u00f3w became part of the kingdom of Bohemia. The first appearance of the city's name in historical records dates back to 966, when a Sephardi Jewish traveller, Abraham ben Jacob, described Krak\u00f3w as a notable commercial centre under the rule of the then duke of Bohemia (Boleslaus I the Cruel). He also mentioned the baptism of Prince Mieszko I and his status as the first historical ruler of Poland. Towards the end of his reign, Mieszko took Krak\u00f3w from the Bohemians and incorporated it into the holdings of the Piast dynasty.", "Krak\u00f3w (Cracow) is one of the largest and oldest cities in Poland, with the urban population of 756,441 (2008). Situated on the Vistula river () in the Lesser Poland region, the city dates back to the 7th century. It was the capital of Poland from 1038 to 1596, the capital of the Grand Duchy of Krak\u00f3w from 1846 to 1918, and the capital of Krak\u00f3w Voivodeship from the 14th century to 1999. It is now the capital of the Lesser Poland Voivodeship. The earliest known settlement on the present site of Krak\u00f3w was established on Wawel Hill, and dates back to the 4th century. Legend attributes the town's establishment to the mythical ruler Krakus, who built it above a cave occupied by a ravenous dragon, Smok Wawelski. Many knights unsuccessfully attempted to oust the dragon by force, but instead, Krakus fed it a poisoned lamb, which killed the dragon. The city was free to flourish. Dragon bones, most likely that of mammoth, are displayed at the entrance of the Wawel Cathedral. Before the Polish state had been formed, Krak\u00f3w was the capital of the tribe of Vistulans, subjugated for a short period by Great Moravia. After Great Moravia was destroyed by the Hungarians, Krak\u00f3w became part of the kingdom of Bohemia. The first appearance of the city's name in historical records dates back to 966, when a Sephardi Jewish traveller, Abraham ben Jacob, described Krak\u00f3w as a notable commercial centre under the rule of the then duke of Bohemia (Boleslaus I the Cruel). He also mentioned the baptism of Prince Mieszko I and his status as the first historical ruler of Poland. Towards the end of his reign, Mieszko took Krak\u00f3w from the Bohemians and incorporated it into the holdings of the Piast dynasty.", "Krak\u00f3w (, ; ), also spelled Cracow or Krakow, is the second largest and one of the oldest cities in Poland. Situated on the Vistula River in the Lesser Poland region, the city dates back to the 7th century. Krak\u00f3w was the official capital of Poland until 1596 and has traditionally been one of the leading centres of Polish academic, economic, cultural and artistic life. Cited as one of Europe's most beautiful cities, its Old Town was declared a UNESCO World Heritage Site. The city has grown from a Stone Age settlement to Poland's second most important city. It began as a hamlet on Wawel Hill and was already being reported as a busy trading centre of Slavonic Europe in 965. With the establishment of new universities and cultural venues at the emergence of the Second Polish Republic in 1918 and throughout the 20th century, Krak\u00f3w reaffirmed its role as a major national academic and artistic centre. The city has a population of about 770,000, with approximately 8 million additional people living within a radius of its main square.", "Around the year 1000, the Roman Catholic Archdiocese of Krak\u00f3w was created, and its borders covered whole area of Lesser Poland. During the reign of Casimir I the Restorer, Krak\u00f3w for the first time became the capital of Poland (around 1040), since Greater Poland and Silesia, with main Polish urban centers, such as Gniezno and Pozna\u0144 were ravaged by Duke Bretislaus I of Bohemia. In 1138, following the Testament of Boles\u0142aw III Krzywousty, the country was divided between his sons (see also Fragmentation of Poland). Boles\u0142aw III Wrymouth created the Seniorate Province, which, among others, consisted of Krak\u00f3w. At the same time, Lesser Poland was divided into two parts, when its eastern part formed the Duchy of Sandomierz, carved by the ruler for his son Henry of Sandomierz.", "P\u0142ock is now a capital of the \"powiat\" (county) in the west of the Mazovian Voivodeship. From 1079 - 1138 it was the first historical capital of Poland. Its cathedral contains the sarcophagi of a number of Polish monarchs. It is the cultural, academic, scientific, administrative and transportation center of the west and north Masovian region. The first Jewish settlers came to the city in the 14th century, responding to the extension of rights by the Polish kings. They built a community and constituted a large portion of the population through the 19th century, sometimes more than 40%. Jews contributed to expansion of trades and crafts, and helped the process of industrialization. In 1939, they made up 26% of the city's population. After the 1939 invasion of Poland, the German Nazis established a Jewish ghetto in P\u0142ock in 1940. They deported many of the Jews to other areas but exterminated most of them in the Holocaust. By the war's end, only 300 Jewish residents were known to have survived, of more than 10,000 in the region.", "During the rule of the first monarchs of the Piast dynasty, even prior to the Baptism of Poland, P\u0142ock served as one of the monarchial seats, including that of Prince Mieszko I and King Boles\u0142aw I the Brave. The king built the original fortifications on Tumskie Hill, overlooking the Vistula River. From 1037\u20131047, P\u0142ock was capital of the independent Mazovian state of Mas\u0142aw. P\u0142ock has been the residence of many Mazovian princes. From 1079 to 1138, the city was the capital of Poland, then earning its title as the Ducal Capital City of P\u0142ock (). It served as the medieval capital during the reigns of the Polish monarchs W\u0142adys\u0142aw I Herman and Boles\u0142aw III Wrymouth.", "During the rule of the first monarchs of the Piast dynasty, even prior to the Baptism of Poland, P\u0142ock served as one of the monarchial seats, including that of Prince Mieszko I and King Boles\u0142aw I the Brave. The king built the original fortifications on Tumskie Hill, overlooking the Vistula River. From 1037\u20131047, P\u0142ock was capital of the independent Mazovian state of Mas\u0142aw. P\u0142ock has been the residence of many Mazovian princes. From 1079 to 1138, the city was the capital of Poland, then earning its title as the Ducal Capital City of P\u0142ock (). It served as the medieval capital during the reigns of the Polish monarchs W\u0142adys\u0142aw I Herman and Boles\u0142aw III Wrymouth.", "ALTE's international conferences are held in different cities in Europe: Barcelona, Spain (2002); Berlin, Germany (2005); Cambridge, UK (2008); Krakow, Poland (2011); Paris,France (2014); Bologna, Italy (2017) ) with regional conferences in Perugia, Prague, Budapest, Sofia, and Lisbon. Similarly, there are regional meetings in China, Japan, Korea, and Taiwan. International conference themes have included supporting the European Year of Languages (2001), the impact of multilingualism (2005), the wider social and educational impact of assessment (2008) and the role of language frameworks (2011). Selected conference papers have been published through the Studies in Language Testing (SiLT) volumes.", "After the war, some survivors emerged from hiding with the Christian rescuers or returned from the Soviet Union, and reestablished a small Jewish community in the city, but their numbers were insignificant. Most left Poland for Israel and the West. On 24 July 1944, the city was taken by the Soviet Army and became the temporary headquarters of the Soviet-controlled communist Polish Committee of National Liberation established by Joseph Stalin, which was to serve as basis for a puppet government. The capital of new Poland was moved to Warsaw in January 1945 after the Soviet westward offensive."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[248, 252], [248, 251], [243, 252], [255, 259], [236, 240], [94, 105], [438, 450], [438, 442], [160, 164], [549, 561]], "rd_topk": 1}, "test_2049": {"question": "Who had won the first Grammy award for the best new artist", "answer": ["Chance the Rapper", "Bobby Darin"], "prediction": ["Andreas Vollenweider,", "Ibrahim Ferrer", "DJ Jazzy Jeff & The Fresh Prince", "Bob Dylan", "Bob Newhart", "Andreas Vollenweider", "Judy Garland", "Christopher Cross", "Milli Vanilli.", "Ibrahim Ferrer"], "score": [87.12529754638672, 86.85102844238281, 86.06942749023438, 84.95689392089844, 84.91218566894531, 84.37969207763672, 83.73255920410156, 83.64488220214844, 83.62095642089844, 83.24557495117188], "title": [["New-age music"], ["Latin Grammy Award for Best New Artist"], ["Grammy Award for Best Rap Performance"], ["Grammy Award for Best Male Rock Vocal Performance"], ["Grammy Award for Best New Artist"], ["Grammy Award for Best New Age Album"], ["Grammy Award for Album of the Year"], ["Grammy Award for Song of the Year"], ["32nd Annual Grammy Awards"], ["1st Annual Latin Grammy Awards"]], "evidence": ["However, many musicians and composers dismiss the labeling of their music as \"New age\". When the Grammy Award for Best New Age Album was first created in 1987, its first winner, Andreas Vollenweider, said \"I don't have any intention to label my music... It's ridiculous to give a name to anything that is timeless\". Peter Bryant, music director of WHYY-FM (90.9) and host of a New-age program, noted that \"I don't care for the term... New-age has a negative connotation... In the circles I come in contact with, people working in music, 'new-age' is almost an insult\", that it refers to \"very vapid, dreamy kinds of dull music... with no substance or form or interest\", and that the term has \"stuck\".", "The award for Best New Artist was first presented to the Cuban performer Ibrahim Ferrer in 2000. Benefiting from the release of the documentary \"Buena Vista Social Club\", which launched him to stardom, Ferrer received the award at age seventy-three after being a performer for sixty years. The next three award recipients were Juanes, Jorge Moreno, and David Bisbal. In 2004, Brazilian singer Maria Rita became the first female winner. Spanish singer-songwriter Bebe announced her retirement one year after receiving the 2005 award; however, she returned to the music business five years later with the release of her second album, \"Y.\" The bands Calle 13 and Jesse & Joy won the next two awards, followed by singers Kany Garc\u00eda, Alexander Acha, Alex Cuba, Sie7e, Mexican DJ's 3Ball MTY, Gaby Moreno, Mariana Vega, Manuel Medrano, Vicente Garc\u00eda, and Karol G. The award has been presented to seven male and six female artists; 3Ball MTY, Calle 13, Jesse & Joy and Monsieur Perin\u00e9 are the only ensembles to earn the award. Since its inception, the award has been presented to musicians or groups originating from Brazil, Colombia, Cuba, Mexico, Puerto Rico, the Dominican Republic and Spain. Each year is linked to the article about the Latin Grammy Awards held that year.", "The Grammy Awards, an annual ceremony established in 1958, and originally called the Gramophone Awards, are presented by the National Academy of Recording Arts and Sciences (NARAS) of the United States to \"honor artistic achievement, technical proficiency and overall excellence in the recording industry, without regard to album sales or chart position\". The first award for Best Rap Performance was presented to DJ Jazzy Jeff & The Fresh Prince (the vocal duo consisting of DJ Jazzy Jeff and Will Smith) for \"Parents Just Don't Understand\". The ceremony was not without controversy; nominees Jeff and Smith led a boycott in protest of the awards presentation not being televised, and some members of the rap community felt that more qualified artists were overlooked.", "Originally called the Grammy Award for Best Rock Vocal Performance, Male, the award was first presented to Bob Dylan in 1980. Beginning with the 1995 ceremony, the name of the award was changed to Best Male Rock Vocal Performance. However, in 1988, 1992, 1994, and since 2005, this category was combined with the Grammy Award for Best Female Rock Vocal Performance and presented in a genderless category known as Best Rock Vocal Performance, Solo. The solo category was later renamed to Best Solo Rock Vocal Performance beginning in 2005. This fusion has been criticized, especially when females are not nominated under the solo category. The Academy has cited a lack of eligible recordings in the female rock category as the reason for the mergers. While the award has not been presented since the category merge in 2005, an official confirmation of its retirement has not been announced.", "The category is also notable for being the only one of its kind in which a Grammy Award was vacated. This occurred in 1990 after it was revealed winners Milli Vanilli did not contribute their own vocals on their debut album. The award was revoked, but was not handed out to another artist. Of the 54 awards presented in the category since its inception, the honor has been presented to 26 solo female artists, 18 duos or groups, and 11 solo male artists. Between 1997 and 2003, all the winners were solo female artists. Also, from 1993 to 2005, no winner was a solo male artist. In 2006, John Legend broke this trend, which started with Marc Cohn in 1992. Only four artists have won both Best New Artist and Album of the Year in the same year: Bob Newhart in 1961, Christopher Cross in 1981, Lauryn Hill in 1999, and Norah Jones in 2003.", "Originally called the Grammy Award for Best New Age Recording, the honor was first presented to Swiss musician Andreas Vollenweider at the 29th Grammy Awards in 1987 for his album \"Down to the Moon\". Two compilation albums featuring Windham Hill Records artists were nominated that same year. The record label was founded by William Ackerman, later an award nominee and 2005 winner for the album \"Returning\". From 1988 to 1991 the category was known as Best New Age Performance. Since 1992 the award has been presented as Best New Age Album. Beginning in 2001, award recipients included the producers, engineers, and/or mixers associated with the nominated work in addition to the recording artists.", "The first woman to win the award was Judy Garland in 1962, for \"Judy at Carnegie Hall\". Taylor Swift and Adele are the only women to win the award more than once for their own albums (winning for \"Fearless\" and \"1989\" and \" 21\" and \"25\", respectively; Swift was also nominated for \"Red\"). In addition, Lauryn Hill, Norah Jones and Alison Krauss are all tied with Swift and Adele with two wins overall, each winning as lead artist for their respective albums, \"The Miseducation of Lauryn Hill\", \"Come Away with Me\" and \"Raising Sand\" (Krauss' collaboration album with Robert Plant); Hill won her second as a producer of her collaboration on Santana's \"Supernatural\" (featured artists on non-soundtrack albums did not share in the award before 2008), while the other two also won as featured artists (Jones on Herbie Hancock's \"\" and Krauss on the \"O Brother, Where Art Thou?\" soundtrack). Also, for their own albums, besides Swift and Adele, only two female artists have received nominations after previously winning (Bonnie Raitt nominated again for \"Luck of the Draw\" and \"Longing in Their Hearts\", after winning previously for \"Nick of Time\", and Barbra Streisand nominated again for \"People\", \"My Name Is Barbra\", \"Color Me Barbra\", \"Guilty\" and \"The Broadway Album\", after winning previously for \"The Barbra Streisand Album\").", "Multiple winners in this category include Henry Mancini (1962 and 1964), Johnny Mercer (1962 and 1964), James Horner (1988 and 1999), Will Jennings (1993 and 1999) U2 (2001 and 2006) and Adele (2012 and 2017), winning two times each. However, songs written for Andy Williams, Barbra Streisand, Bette Midler, and Roberta Flack have received this award twice. Christopher Cross is the first artist to receive the Grammy Award for Song of the Year as well as for Record of the Year, Album of the Year, and Best New Artist in one ceremony. Adele is the first female artist to receive the award for Song of the Year, Record of the Year, Best New Artist, and Album of the Year, nonconsecutively. Only five artists have won the Song of the Year and Best New Artist awards the same year: Christopher Cross (1981), Alicia Keys (2002), Amy Winehouse (2008), Fun (2013), and Sam Smith. The song \"Volare\", winner in 1959 by Domenico Modugno and performed in Italian, is the only foreign-language song to win this award, although the 1967 winner \"Michelle\" by the Beatles has a critical part of its lyrics in French. As of 2017, no songwriter has won Song of the Year twice in a row.", "The 32nd Annual Grammy Awards were held in 1990. They recognized accomplishments by musicians from the previous year. The award for Best New Artist was originally awarded to Milli Vanilli. In November 1990, the National Academy of Recording Arts and Sciences revoked Milli Vanilli's Grammy, after Milli Vanilli members Robert Pilatus and Fabrice Morvan and their producer, Frank Farian, admitted the duo \"did not sing a note\" on their album, \"Girl You Know It's True\".", "On September 12, 2000 Sony Discos released the first \"Latin Grammy Nominees CD\" to coincide with the inaugural awards with nominees from three categories, Record of the Year, Best Female Pop Vocal Performance and Best Tropical Song, with a portion of the proceeds to support the Latin Academy Of Recording Arts and Sciences for community-outreach efforts. It was expected that various labels took turns releasing Latin Grammy sets each year. The nominations were announced on July 7, 2000 and the winners were revealed on September 13, 2000, including Man\u00e1, Luis Miguel and Santana each grabbing three trophies at the event. Santana and Man\u00e1 won Record of the Year for the track \"Coraz\u00f3n Espinado\" from Santana's album, \"Supernatural\" and the same track was honored for Rock Duo or Group with Vocal. Man\u00e1 also won Best Pop Performance and Santana won Best Pop Instrumental. \"Amarte Es Un Placer\", by Mexican pop singer Luis Miguel won Album of the Year, Best Pop Album and Best Male Pop Performance. Marc Anthony's \"D\u00edmelo\" picked up Song of the Year, and at age 73, Ibrahim Ferrer won Best New Artist. Emilio Estefan Jr., who was up for six honors, won only two awards: Producer of the Year and the Music Video award for directing his wife Gloria's \"No Me Dejes de Querer\". Meanwhile, Carlos Vives, also with six nominees, went home with no trophies. Tito Puente won posthumously for Traditional Tropical Performance for the title track from his final album, \"Mambo Birdland\". His son and daughter accepted the award on his behalf. Winners were chosen by voting members of the Latin Academy from a list of finalists. The ceremony was broadcast live on CBS and was seen in more than 100 countries across the world."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[178, 199], [73, 87], [414, 446], [107, 116], [744, 755], [111, 131], [37, 49], [358, 375], [174, 188], [1067, 1081]], "rd_topk": 2}, "test_2050": {"question": "What is the purse for the senior open", "answer": ["$2 million in 2011"], "prediction": ["$2 million", "$4 million", "$120,000", "$12 million", "$3.75 million", "$720,000", "$50 million", "$12 million", "$11 million", "US$53 million"], "score": [80.33706665039062, 79.43894958496094, 79.34733581542969, 77.30024719238281, 77.21267700195312, 76.91761779785156, 76.81156158447266, 76.49308776855469, 76.41159057617188, 76.3970718383789], "title": [["Senior Open Championship"], ["U.S. Senior Open"], ["2017 U.S. Open Grand Prix Gold"], ["U.S. Open (golf)"], ["U.S. Senior Open"], ["U.S. Senior Open"], ["2013 French Open"], ["The Players Championship"], ["PGA Championship"], ["US Open (tennis)"]], "evidence": ["The Senior Open Championship, or simply The Senior Open (and originally known as the Senior British Open) is a professional golf tournament for players aged 50 and over. It is run by The R&A, the same body that organises The Open Championship. Prize money won in the event is official money on both PGA Tour Champions (formerly the Senior PGA Tour and Champions Tour) and the European Senior Tour. The purse, which is fixed in United States dollars, was $2 million in 2011, with a winner's share of $315,600. For sponsorship reasons, it is currently known as The Senior Open Championship presented by Rolex.", "Allen Doyle became the oldest U.S. Senior Open Champion in 2006, winning two weeks before his 58th birthday. The total purse was the highest of any senior tour event until the Posco E&C Songdo Championship in South Korea, a Champions Tour event in 2010 and 2011 with a $3 million purse, but had a lower winner's share ($450,000). The U.S. Senior Open is again the highest purse on the PGA Tour Champions; in 2016 it was $3.75 million, and champion Gene Sauers earned $675,000. The purse in 2017 is anticipated to be $4 million, yielding a winner's share of $720,000.", "The 2017 U.S. Open Grand Prix Gold, is the eleventh Grand Prix's badminton tournament of the 2017 BWF Grand Prix Gold and Grand Prix and the 55th edition of the U.S. Open tournament. The tournament was held at the Anaheim Convention Center in Anaheim, California, United States on 19 \u2013 23 July 2017 and had a total purse of $120,000.", "The purse at the 2017 U.S. Open was $12 million, and the winner's share was $2.16 million. The European Tour uses conversion rates at the time of the tournament to calculate the official prize money used in their Race to Dubai (\u20ac10,745,927 in 2017). In line with the other majors, winning the U.S. Open gives a golfer several privileges that make his career much more secure if he is not already one of the elite players of the sport. U.S. Open champions are automatically invited to play in the other three majors (the Masters, The Open Championship (British Open), and the PGA Championship) for the next five years, as well as The Players Championship, and they are exempt from qualifying for the U.S. Open itself for 10 years.", "Allen Doyle became the oldest U.S. Senior Open Champion in 2006, winning two weeks before his 58th birthday. The total purse was the highest of any senior tour event until the Posco E&C Songdo Championship in South Korea, a Champions Tour event in 2010 and 2011 with a $3 million purse, but had a lower winner's share ($450,000). The U.S. Senior Open is again the highest purse on the PGA Tour Champions; in 2016 it was $3.75 million, and champion Gene Sauers earned $675,000. The purse in 2017 is anticipated to be $4 million, yielding a winner's share of $720,000.", "Allen Doyle became the oldest U.S. Senior Open Champion in 2006, winning two weeks before his 58th birthday. The total purse was the highest of any senior tour event until the Posco E&C Songdo Championship in South Korea, a Champions Tour event in 2010 and 2011 with a $3 million purse, but had a lower winner's share ($450,000). The U.S. Senior Open is again the highest purse on the PGA Tour Champions; in 2016 it was $3.75 million, and champion Gene Sauers earned $675,000. The purse in 2017 is anticipated to be $4 million, yielding a winner's share of $720,000.", "The French Open's total prize money for 2013 has been increased by more than three million euros to 22 million euros ($28.77 million). The winners of the men's and women's singles titles will each earn 1.5 million euros, up 250,000 euros from last year. The move was part of plans to boost the total prize money by a further 10 million euros to 32 million euros by 2016. In comparison, US Open prize money will reach $33.6 million this year and rise to $50 million by 2017, while Wimbledon prize money was more than 16 million pounds ($24.61 million) in 2012. In the 2013 season, the French Open's prize money is the lowest out of four grand slam tournaments, compared to $30m at the Australian Open, $34m at Wimbledon, and $32m at the US Open.", "The Players Championship (commonly known as simply The Players, stylized by the PGA Tour as The PLAYERS Championship) is an annual golf tournament on the PGA Tour. Originally known as the Tournament Players Championship, it began in 1974. For many years, the Players Championship offered the highest prize fund of any tournament in golf ($10.5 million in 2016) until it was overtaken in 2017 by the U.S. Open, which offered a $12 million purse. The field usually includes the top 50 players in the world rankings, but unlike the three major championships or two World Golf Championships events staged in the United States, it is not an official event on the European Tour.", "The PGA Championship (often referred to as the U.S. PGA Championship or U.S. PGA outside the United States) is an annual golf tournament conducted by the Professional Golfers' Association of America. It is one of the four major championships in professional golf. It was formerly played in mid-August on the third weekend before Labor Day weekend, serving as the fourth and final major of the golf season. Beginning 2019, the tournament will be played in May on the weekend before Memorial Day, as the season's second major. It is an official money event on the PGA Tour, European Tour, and Japan Golf Tour, with a purse of $11 million for the 100th edition in 2018.", "In 2007, JP Morgan Chase renewed its sponsorship of the US Open and, as part of the arrangement, the replay system was renamed to \"Chase Review\" on in-stadium video and television. The total prize money for the 2018 US Open is US$53 million. Of that amount, US$50,565,840 is for player base compensation and is divided as follows: The men's and women's singles prize money (US$40,912,000) accounts for 80.9 percent of total player base compensation, while men's and women's doubles (US$6,140,840), men's and women's singles qualifying (US$3,008,000), and mixed doubles (US$505,000) account for 12.1 percent, 5.9 percent, and 1.0 percent, respectively. The prize money for the wheelchair draw amounts to a total of US$350,000. The singles winners of the men and women draws receive US$31,200 and the winner of the quad singles receives US$23,400."], "em_top1": false, "em_top10": false, "f1_top1": 0.6666666666666666, "f1_top10": 0.6666666666666666, "se_pos": [[454, 464], [516, 526], [324, 332], [36, 47], [420, 433], [557, 565], [453, 464], [426, 437], [624, 635], [227, 240]], "rd_topk": 1}, "test_2051": {"question": "Where will the cricket World Cup 2019 be held", "answer": ["England and Wales"], "prediction": ["England and Wales", "England", "England", "England", "England and Wales", "Wales", "England and Wales", "England", "England and Wales", "India"], "score": [88.34771728515625, 87.85559844970703, 87.1834945678711, 86.583251953125, 86.20655059814453, 86.16444396972656, 85.82275390625, 83.17292785644531, 82.81623077392578, 82.57260131835938], "title": [["2019 Cricket World Cup"], ["2019 Cricket World Cup"], ["International cricket in 2019"], ["Major sports event hosting in Britain during the 2010s"], ["International cricket in 2019"], ["2019 Cricket World Cup"], ["Major sports event hosting in Britain during the 2010s"], ["2015 Cricket World Cup"], ["2019 Cricket World Cup"], ["2023 Cricket World Cup"]], "evidence": ["The 2019 Cricket World Cup (officially ICC Cricket World Cup 2019) is the 12th edition of the Cricket World Cup, scheduled to be hosted by England and Wales, from 30 May to 14 July 2019. The hosting rights were awarded in April 2006, after England and Wales withdrew from the bidding to host the 2015 ICC Cricket World Cup, which was held in Australia and New Zealand. The first match will be played at The Oval while the final will be played at Lord's. It is the fifth time that the Cricket World Cup will be held in England and Wales, following the 1975, 1979, 1983 and 1999 World Cups.", "The 2019 Cricket World Cup (officially ICC Cricket World Cup 2019) is the 12th edition of the Cricket World Cup, scheduled to be hosted by England and Wales, from 30 May to 14 July 2019. The hosting rights were awarded in April 2006, after England and Wales withdrew from the bidding to host the 2015 ICC Cricket World Cup, which was held in Australia and New Zealand. The first match will be played at The Oval while the final will be played at Lord's. It is the fifth time that the Cricket World Cup will be held in England and Wales, following the 1975, 1979, 1983 and 1999 World Cups.", "The 2019 international cricket season is from May 2019 to September 2019. The 2019 Cricket World Cup in England and Wales is scheduled to take place during this time, starting on 30 May 2019. Currently, 8 Test matches, 73 One-day Internationals (ODIs) and 7 Twenty20 Internationals (T20Is) are scheduled to be played during this period. The inaugural 2019\u201321 ICC World Test Championship is scheduled to start with India playing two Tests against the West Indies in July 2019 after the 2019 Cricket World Cup.", "The 2019 Cricket World Cup will be hosted by England and Wales. This will be the twelfth World Cup competition, and the fifth time it has been held in England, having played host in 1975, 1979, 1983 and 1999. The hosting rights were awarded in April 2006, after England withdrew from the bidding to host the 2015 Cricket World Cup, which was held in Australia and New Zealand. In turn, those countries had been defeated by India, Pakistan, Bangladesh, and Sri Lanka for the right to stage the 2011 contest.", "The 2019 international cricket season is from May 2019 to September 2019. The 2019 Cricket World Cup in England and Wales is scheduled to take place during this time, starting on 30 May 2019. Currently, 8 Test matches, 73 One-day Internationals (ODIs) and 7 Twenty20 Internationals (T20Is) are scheduled to be played during this period. The inaugural 2019\u201321 ICC World Test Championship is scheduled to start with India playing two Tests against the West Indies in July 2019 after the 2019 Cricket World Cup.", "The 2019 Cricket World Cup (officially ICC Cricket World Cup 2019) is the 12th edition of the Cricket World Cup, scheduled to be hosted by England and Wales, from 30 May to 14 July 2019. The hosting rights were awarded in April 2006, after England and Wales withdrew from the bidding to host the 2015 ICC Cricket World Cup, which was held in Australia and New Zealand. The first match will be played at The Oval while the final will be played at Lord's. It is the fifth time that the Cricket World Cup will be held in England and Wales, following the 1975, 1979, 1983 and 1999 World Cups.", "The 2019 Cricket World Cup will be hosted by England and Wales. This will be the twelfth World Cup competition, and the fifth time it has been held in England, having played host in 1975, 1979, 1983 and 1999. The hosting rights were awarded in April 2006, after England withdrew from the bidding to host the 2015 Cricket World Cup, which was held in Australia and New Zealand. In turn, those countries had been defeated by India, Pakistan, Bangladesh, and Sri Lanka for the right to stage the 2011 contest.", "The hosting rights were awarded at the same time as those of the 2011 Cricket World Cup, which Australia and New Zealand had originally bid to host, and the 2019 Cricket World Cup, which was awarded to England. The 2011 tournament was awarded to the four Asian Test cricket playing countries: India, Pakistan, Sri Lanka and Bangladesh (Pakistan later lost the co-hosting rights due to a terrorist attack on the Sri Lankan team). The International Cricket Council were sufficiently impressed with the trans-Tasman bid that it was decided to award the next World Cup to Australia and New Zealand. This was the second time the tournament was held in Australia and New Zealand, with the first being the 1992 Cricket World Cup.", "The 2019 Cricket World Cup (officially ICC Cricket World Cup 2019) is the 12th edition of the Cricket World Cup, scheduled to be hosted by England and Wales, from 30 May to 14 July 2019. The hosting rights were awarded in April 2006, after England and Wales withdrew from the bidding to host the 2015 ICC Cricket World Cup, which was held in Australia and New Zealand. The first match will be played at The Oval while the final will be played at Lord's. It is the fifth time that the Cricket World Cup will be held in England and Wales, following the 1975, 1979, 1983 and 1999 World Cups.", "The 2023 Cricket World Cup (officially ICC Cricket World Cup 2023) will be the 13th edition of the Cricket World Cup, scheduled to be hosted by India, from 9 February to 26 March 2023. This will be the first time the competition is held completely in India (three previous editions were partially hosted there \u2013 1987, 1996, and 2011). As with the previous edition, the tournament will feature ten teams. The main route to qualification will be the new ICC ODI League tournament, which replaces the ICC ODI Championship. For the World Cup, the top seven sides plus the hosts (India) from the thirteen competitors in the League will qualify automatically. The remaining five teams, along with an undecided number of Associate sides, will play in the 2022 Cricket World Cup Qualifier, from which two sides will go through to the final tournament."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[139, 156], [139, 146], [104, 111], [45, 52], [104, 121], [151, 156], [45, 62], [202, 209], [518, 535], [144, 149]], "rd_topk": 4}, "test_2052": {"question": "What channel does Thursday night football come on regular TV", "answer": ["NBC"], "prediction": ["Fox", "Fox", "CBS", "Westwood One", "CBS", "CBS", "CBS", "Fox", "NBCSN", "NFL Network"], "score": [85.89488220214844, 84.88697814941406, 84.43452453613281, 84.08895874023438, 84.0731201171875, 84.07160949707031, 83.93869018554688, 83.92588806152344, 83.53499603271484, 83.51774597167969], "title": [["NFL on NBC"], ["Thursday Night Football"], ["Thursday Night Football"], ["Thursday Night Football"], ["History of the National Football League on television"], ["Thursday Night Football"], ["Thursday Night Football"], ["Thursday Night Football"], ["Wednesday Night Rivalry"], ["Thursday Night Football"]], "evidence": ["On February 1, 2016, the league announced that NBC had won a partial share of \"Thursday Night Football\" rights for the 2016 season; as a result, five additional Thursday night games (in addition the kickoff and Thanksgiving contests) in the later part of the season had been added to NBC's schedule. NBC Sports was also responsible for producing five games that was exclusive to NFL Network. After the 2017 season, NBC insisted on a reduced rights fee in order to continue carrying \"Thursday Night Football\", which the NFL rejected; Fox was then awarded the rights to \"Thursday Night Football\" for the remainder of the time left on the league's broadcast contracts. NBC will continue to carry the kickoff and Thanksgiving night games on Thursdays.", "In 2018, the NFL reached a long-term deal with Fox to hold the rights through 2022. The games are broadcast on radio via Westwood One, which syndicates the broadcasts to its partner radio stations around the United States. In 2016, the NFL also began to sub-license digital streaming rights to the broadcast TV portion of the package to third-parties, beginning with Twitter in 2016, and Amazon Prime Video in 2017, which Amazon and the NFL renewed their contract through 2019, with Twitch set to air some games in 2018.", "On February 5, 2014, the NFL announced that CBS had acquired the partial rights to \"Thursday Night Football\" for the 2014 season. Under the agreement, all of the \"Thursday Night Football\" telecasts would be produced by CBS Sports and called by the network's primary announcing team of Jim Nantz and Phil Simms. The first eight games of the season were simulcast nationally on NFL Network and CBS; the remaining games in the package only aired nationally on NFL Network, but per league broadcast policies, were simulcast on local stations in the participating teams' markets. CBS affiliates were given right of first refusal to air the local simulcast before it is offered to another station (as had occurred in Cincinnati, Ohio where the market's NBC affiliate WLWT aired a game between the Bengals and the Cleveland Browns instead of CBS affiliate WKRC-TV). A Saturday doubleheader was also added on Week 16: NFL Network aired the early game, while CBS aired the second, prime time game.", "Westwood One provides national radio broadcasts of the \"Thursday Night Football\" games through a contract of currently unknown length (Westwood One quietly renewed the rights after parent company Cumulus Media departed a Chapter 11 bankruptcy). During the 2017 season, Ian Eagle called play-by-play, with Tony Boselli handling color analysis and Hub Arkush as the sideline reporter. Until 2018, Boomer Esiason, the \"Monday Night Football\" analyst for Westwood One, has been a regular substitute if Boselli was unavailable due to other commitments (in some cases, Esiason would call the Thursday night game if he is unavailable for the previous/next Monday night game and/or if the Thursday game is in close proximity to his New York home).", "On February 5, 2014, the league announced it had sold off eight weeks of the NFL Network's \"Thursday Night Football\" package to CBS, who outbid competitors ABC, Fox, NBC, and Turner Sports. NFL Network will simulcast CBS' Thursday night games from weeks 2 through 8, will continue to carry the Thursday night games from Week 9 onward, and will also carry two Saturday night games (Week 16 doubleheader) for the first time since 2011, with one of those games being simulcast on CBS. All of these games (except for the one NFL Network-only Saturday night game) will be announced by CBS' lead commentating team of Jim Nantz (play-by-play) and Phil Simms (color analyst). The deal with CBS was initially only for the 2014 season, with the league having the option to extend it for an additional season. CBS is paying an additional $275 million for the package. Local CBS affiliates automatically get the local simulcast rights to any game carried only on NFL Network. The league exercised the option to extend its agreement with CBS through the 2015 season. For 2016 and 2017, the league split a ten-game package of Thursday night games between NBC and CBS, with each paying an estimated $225 million per season for five games; CBS's games will be in the early part of the season as before, while NBC's will cover later in the season. Under the terms of NFL Network's retransmission agreements with cable providers, the NFL has included a stipulation requiring seven games in the \"Thursday Night Football\" package to be carried solely on NFL Network; for the 2018 season, potential bidders were free to place a bid on a package ranging from anywhere between four and eleven games. Fox, the winning bidder, bought all eleven games that were up for bids. As the eighteen total games involve more time slots than can be accommodated with the fourteen Thursday night time slots (excluding the kickoff, Thanksgiving, and the last week of the season when no Thursday game is played), four of the games are played on days other than Thursdays (usually this involves at least one game in London in a Sunday morning time slot and the remainder on Saturdays, all NFL Network exclusives), or if Christmas lands on a Monday, either a Christmas Eve or Christmas Day game.", "The move of selected games to CBS brought improved ratings: the inaugural game was the highest-rated program of the night, with an audience share of 13.7 and an average of 20.7 million viewers, representing a 108% increase in ratings over the first NFL Network game in 2013. The game, whose ratings were boosted by coverage of the Ray Rice scandal, also brought CBS its highest prime time ratings on a Thursday night since May 2006. While lower, at 9.6 million viewers, the Week 3 game between the Atlanta Falcons and Tampa Bay Buccaneers was also the highest-rated program of the night. The first four games of the package, however, featured blowout victories. In total, average viewership of the games increased from around 7 million to around 11.8 million in the 2014 season.", "With the move of selected games to CBS, media executives expected more major match-ups to appear on \"Thursday Night Football\" than in previous years in order to attract better viewership; in the past, \"Thursday Night Football\" had been criticized for often featuring games between lesser and poorer-performing teams. CBS and the NFL unveiled the games scheduled for \"Thursday Night Football\" in April 2014; CBS's slate of games featured a number of major divisional rivalries, including New York Giants\u2013Washington, Green Bay\u2013Minnesota, and its opening game on September 11, 2014, featuring the Pittsburgh Steelers and the Baltimore Ravens.", "Amazon renewed its digital rights for the 2018 and 2019 season; in contrast to 2017 in which the games required an Amazon Prime subscription, for 2018 and 2019, Amazon also carries game coverage for free on its live streaming platform Twitch. Alongside the main Fox feed, British English, and Spanish options, the Amazon Prime streams offer an alternate commentary feed featuring ESPN anchor Hannah Storm and NFL Network chief correspondent Andrea Kremer\u2014the first all-female commentary team in NFL history. The Twitch streams offer access to the service's standard chat room (along with special football-themed emotes), an interactive extension, and co-streams featuring prominent personalities, while streams on Amazon Fire devices offer integration with the X-Ray feature to access statistics and other content.", "Wednesday Night Hockey is the branding used for National Hockey League games that air on NBCSN on Wednesday nights during the regular season. In the 2012\u201313 NHL season, NBCSN rebranded their coverage of Wednesday night games as \"Wednesday Night Rivalry\". It primarily featured rivalry games, although the network has received criticism for games which do not seem to include a strong element of rivalry (such as Los Angeles-Detroit, Pittsburgh-Buffalo, and Chicago-Philadelphia) are common. NBCSN sometimes produces a Wednesday Nightcap game primarily featuring Western Conference teams immediately following their \"Wednesday Night Rivalry\" game. Beginning in the 2013\u201314 NHL season, NBCSN aired the series \"NHL Rivals\", which looks back at the participating teams' historic rivalry, leading up to their \"Wednesday Night Rivalry\" game. That same season, NBCSN promoted the games with the slogan \"The Night You Love To Hate\".", "\"Thursday Night Football\" games on NFL Network are among the lowest-rated nationally televised NFL broadcasts. Critics have argued that the games televised on \"Thursday Night Football\" have been of lower quality than other prime time games, as they often featured match-ups between lesser or poor-performing teams, and that the shortened rest between games triggered by Thursday games also has an effect on their overall quality. In an analysis by \"Sports on Earth\" writer Aaron Roberts, it was determined that most Thursday games were of average or above-average quality in comparison to normal, non-prime time games, but that this was \"by design\" due to the leverage of other NFL broadcasters on how games are scheduled throughout the season (which traditionally prioritizes \"major\" games for either late-afternoon or Sunday and Monday nights)."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[533, 536], [47, 50], [44, 47], [0, 12], [128, 131], [30, 33], [35, 38], [262, 265], [89, 94], [35, 46]], "rd_topk": 3}, "test_2053": {"question": "Where does the saying get out of Dodge come from", "answer": ["the drama series Gunsmoke"], "prediction": ["United States", "the United States", "Scat Pack,", "the United States military", "United States military", "the United States", "American", "Sandez v. United States", "the United Kingdom", "baseball terminology"], "score": [81.56598663330078, 80.8369140625, 80.71180725097656, 80.21507263183594, 79.71451568603516, 79.64512634277344, 79.45879364013672, 79.11018371582031, 78.5270004272461, 78.32028198242188], "title": [["Roger Dodger (phrase)"], ["Roger Dodger (phrase)"], ["Go package"], ["Smoke 'em if you got 'em"], ["Smoke 'em if you got 'em"], ["Smoke 'em if you got 'em"], ["You kids get off my lawn!"], ["Unring the bell"], ["A wigwam for a goose's bridle"], ["Out of left field"]], "evidence": ["The phrase \"Roger Dodger\" originated during World War II, and was verbally circulated throughout the United States military as a part of a story about a pilot or soldier that added his own flair to radio phraseology. The punch line of this story is, \"Roger Dodger, you old codger!\" The story was passed along by servicemen in all branches of the military. Here is one version of the story set in the Pacific Theater of Operations of World War II: It is easy to see how the story can be adapted to different military branches and duties but still retain the essential ingredients: the successful war hero in the thick of the action and the overbearing officer concerned only with strict adherence to the regulations.", "The phrase \"Roger Dodger\" originated during World War II, and was verbally circulated throughout the United States military as a part of a story about a pilot or soldier that added his own flair to radio phraseology. The punch line of this story is, \"Roger Dodger, you old codger!\" The story was passed along by servicemen in all branches of the military. Here is one version of the story set in the Pacific Theater of Operations of World War II: It is easy to see how the story can be adapted to different military branches and duties but still retain the essential ingredients: the successful war hero in the thick of the action and the overbearing officer concerned only with strict adherence to the regulations.", "The Go package (or Go Pack) was a factory option that included various performance equipment that was available on several muscle cars manufactured by American Motors Corporation (AMC). During the late-1960s and early-1970s, domestic automakers lines used \"catchy marketing campaigns, such as Dodge's Scat Pack, AMC's Go Package, and Ford's Total Performance.\" American Motors Corporation planned a program to create a performance image that included a pulling-out from the antiquated Automobile Manufacturers Association (AMA) edict against supporting automobile racing that was no longer followed by General Motors. Ford, or Chrysler. Managers at the automaker made a decision \"to go after the youth market ... AMC muscle soon flourished, including not just AMX and Javelin pony cars, but other potent packages like the Hurst SC/Rambler of 1969, Rebel Machine in 1970...\"", "The phrase \"Smoke 'em if you got 'em\" or \"Smoke if you got 'em\" is slang for \"do what you want, if you have the means\". The first phrase was popular in the United States military during World War II, meaning to take a break. Officers would say \"Smoke 'em if you got 'em\", allowing the soldiers to take a break and smoke their cigarettes, \"if you got' em\" referring to the vagaries of war. Cigarettes were nearly impossible to get in Europe during that time because of the deprivations of the war. Along with nylon stockings for women, cigarettes were a luxury item that took on cultural importance beyond their monetary value. Soldiers got a daily allotment of cigarettes with their K ration, the 1940s combat ration equivalent of modern Meals, Ready-to-Eat (MREs). Not all soldiers smoked, and unsmoked cigarettes became a War Department currency. The soldiers traded freely across all borders and social classes. Seventy-five years later, the phrase was a touchstone used in all media to evoke a former heroic period.", "The phrase \"Smoke 'em if you got 'em\" or \"Smoke if you got 'em\" is slang for \"do what you want, if you have the means\". The first phrase was popular in the United States military during World War II, meaning to take a break. Officers would say \"Smoke 'em if you got 'em\", allowing the soldiers to take a break and smoke their cigarettes, \"if you got' em\" referring to the vagaries of war. Cigarettes were nearly impossible to get in Europe during that time because of the deprivations of the war. Along with nylon stockings for women, cigarettes were a luxury item that took on cultural importance beyond their monetary value. Soldiers got a daily allotment of cigarettes with their K ration, the 1940s combat ration equivalent of modern Meals, Ready-to-Eat (MREs). Not all soldiers smoked, and unsmoked cigarettes became a War Department currency. The soldiers traded freely across all borders and social classes. Seventy-five years later, the phrase was a touchstone used in all media to evoke a former heroic period.", "The phrase \"Smoke 'em if you got 'em\" or \"Smoke if you got 'em\" is slang for \"do what you want, if you have the means\". The first phrase was popular in the United States military during World War II, meaning to take a break. Officers would say \"Smoke 'em if you got 'em\", allowing the soldiers to take a break and smoke their cigarettes, \"if you got' em\" referring to the vagaries of war. Cigarettes were nearly impossible to get in Europe during that time because of the deprivations of the war. Along with nylon stockings for women, cigarettes were a luxury item that took on cultural importance beyond their monetary value. Soldiers got a daily allotment of cigarettes with their K ration, the 1940s combat ration equivalent of modern Meals, Ready-to-Eat (MREs). Not all soldiers smoked, and unsmoked cigarettes became a War Department currency. The soldiers traded freely across all borders and social classes. Seventy-five years later, the phrase was a touchstone used in all media to evoke a former heroic period.", "\"You kids get off my lawn!\" is an American expression of the late 20th century and early 21st century. Slight variations include \"Get off my lawn!\" and \"You kids get out of my yard!\" are common. This phrase presents the supposed reaction of a stereotypical elderly middle-class homeowner confronting boisterous children entering or crossing his or her property. Until the late 19th century, private lawns in the modern sense were mainly associated with wealthy estates. The introduction of affordable mechanical manual lawnmowers made it possible for small lawns to be maintained by individuals.", "\"Unring the bell\" is a good analogy which can save a lot of words in making the point. That phrase originated, as far as we can find, in Sandez v. United States [1956], and was elaborated on in Dunn v. United States, which added other pertinent analogies. \"After the thrust of the saber it is difficult to forget the wound,\" was another, and then the most colorful one of all, \"If you throw a skunk into the jury box, you can't instruct the jury not to smell it.\" In the present case there was no skunk thrown in the jury box. As also mentioned in Dunn, \"Trials are rarely, if ever, perfect, but gross imperfections should not go unnoticed.\" We find no gross imperfections which would overpower the district court's instruction to the jury to disregard Lowis' statement.", "A wigwam for a goose's bridle is a phrase, meaning something absurd or a nonsense object, or latterly \"none of your business\". It is an old English phrase from the United Kingdom which later found particular favour in Australia, where its first recorded use is in 1917, and also in New Zealand. An early recorded use is found in an 1836 magazine article, where the phrase is used by an English sailor whose ship was berthed in Calcutta. Originally, the phrase was \"a whim-wham for a goose's bridle\", with \"whim-wham\" a word meaning \"a fanciful or fantastic object\". The phrase was deliberately absurd as a goose would never wear a bridle. Folk etymology converted the word \"whim-wham\"\u2014a word that was no longer much used\u2014to \"wigwam\", an Ojibwa word for a domed single-room dwelling used by Native Americans. This change retained the phrase's absurd meaning and sense.", "\"Out of left field\" is American slang meaning \"unexpectedly\", \"odd\" or \"strange\". The phrase came from baseball terminology, referring to a play in which the ball is thrown from the area covered by the left fielder to either home plate or first base, surprising the runner. According to mlb.com there is another meaning: \"The term 'way out in left field' is taken to mean 'crazy.'\" Cook County Hospital (by the West Side Grounds, the Chicago Cubs first location under what is now the University of Illinois at Chicago College of Medicine) had a mental institution behind left field, The bottom line is, patients could be heard yelling and screaming things at fans behind the left field wall.'\" Variations include \"out in left field\" and simply \"left field\"."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[101, 114], [97, 114], [301, 311], [152, 178], [156, 178], [152, 169], [34, 42], [137, 160], [160, 178], [103, 123]], "rd_topk": 3}, "test_2054": {"question": "When was looking for a sunset bird in winter written", "answer": ["1923"], "prediction": ["December 1967", "1967", "1934", "1964", "1922", "1860", "1965", "1942", "1948", "2001"], "score": [84.3939208984375, 84.03423309326172, 83.64884948730469, 81.82716369628906, 81.77986145019531, 81.71080017089844, 81.44317626953125, 81.12503051757812, 81.03834533691406, 80.86310577392578], "title": [["White Bird (song)"], ["White Bird (song)"], ["Winter Wonderland"], ["Sunrise, Sunset"], ["Stopping by Woods on a Snowy Evening"], ["The Snowman (fairy tale)"], ["Summer Wind"], ["White Christmas (song)"], ["Christmas in the post-war United States"], ["All the Birds in the Sky"]], "evidence": ["\"White Bird\" is a 1969 song by San Francisco rock group It's a Beautiful Day, written by David LaFlamme and his then wife Linda LaFlamme (n\u00e9e Neska). \"White Bird\" was written in December 1967, in Seattle, Washington. Manager Matthew Katz had moved the band there to polish their act at a small Seattle ballroom before booking them into San Francisco nightclubs. Living in the attic of a Victorian house across the street from Volunteer Park, the band had inadequate food and no transportation during a dreary Seattle winter. The song evolved from the depression of the band's circumstances and yearning to be free. The song's repeated chorus is, \"White bird must fly or she will die.\"", "\"White Bird\" is a 1969 song by San Francisco rock group It's a Beautiful Day, written by David LaFlamme and his then wife Linda LaFlamme (n\u00e9e Neska). \"White Bird\" was written in December 1967, in Seattle, Washington. Manager Matthew Katz had moved the band there to polish their act at a small Seattle ballroom before booking them into San Francisco nightclubs. Living in the attic of a Victorian house across the street from Volunteer Park, the band had inadequate food and no transportation during a dreary Seattle winter. The song evolved from the depression of the band's circumstances and yearning to be free. The song's repeated chorus is, \"White bird must fly or she will die.\"", "\"Winter Wonderland\" is a song written in 1934 by Felix Bernard and lyricist Richard B. Smith. Due to its seasonal theme it is often regarded as a Christmas song in the Northern Hemisphere, though the holiday itself is never mentioned in the lyrics. Since its original recording by Richard Himber, it has been covered by over 200 different artists, including Bing Crosby, Dean Martin, Johnny Mathis, Frank Sinatra, Amy Grant, Michael Buble, The Eurythmics, and Radiohead. The song's lyrics are about a couple enjoying a picturesque winter landscape. They build a snowman, who they agree to pretend is Parson Brown. They imagine the snowman asking if the couple is married, to which they tell him that they are not and tell the snowman that he can marry them.", "\"Sunrise, Sunset\" is a song from the musical \"Fiddler on the Roof\" written in 1964 by composer Jerry Bock and lyricist Sheldon Harnick. Lyricist Sheldon Harnick said: The album \"Sheldon Harnick: Hidden Treasures (1949-2013)\" features the demo recording of \"Sunrise, Sunset\" featuring Harnick, accompanied by composer Jerry Bock. Harnick said \"This CD set is supposed to be the unknown songs, and the two men who created it, Bill Rudman (ph) and Ken Bloom (ph), when they said they wanted to use \"Sunrise, Sunset,\" I said but that's a very familiar song. They said not with you singing it.\"", "\"Stopping by Woods on a Snowy Evening\" is a poem written in 1922 by Robert Frost, and published in 1923 in his \"New Hampshire\" volume. Imagery, personification, and repetition are prominent in the work. In a letter to Louis Untermeyer, Frost called it \"my best bid for remembrance\". Frost wrote the poem in June 1922 at his house in Shaftsbury, Vermont. He had been up the entire night writing the long poem \"New Hampshire\" and had finally finished when he realized morning had come. He went out to view the sunrise and suddenly got the idea for \"Stopping by Woods on a Snowy Evening\". He wrote the new poem \"about the snowy evening and the little horse as if I'd had a hallucination\" in just \"a few minutes without strain\".", "Following the departure of Scharff and Eckardt for Salzburg, Andersen traveled to Switzerland but grew despondent and then depressed. In November, he returned to Copenhagen and spent Christmas at Basn\u00e6s, the estate of an aristocratic patron and friend on the coast of Zealand. His spirits lifted with the holiday festivities and \"The Snowman\u201d was composed on New Year\u2019s Eve 1860. It was published with several other new tales by Andersen two months later on 2 March 1861 in \"New Fairy Tales and Stories. Second Series. First Collection. 1861.\" by the Copenhagen publisher C. A. Reitzel.", "\"Der Sommerwind\" was a song composed in 1965 by Heinz Meier, with German language lyrics written by Hans Bradtke. The song was changed to English by Johnny Mercer, who had heard the song being sung by Danish singer Grethe Ingmann who had also recorded the song in her native language as \"Sommervind\". He wrote replacement lyrics along the same theme. The song talks of the sirocco wind which passes from North Africa into Southern Europe at the end of summer, and uses this as a metaphor for the changing of the seasons and the passing of time. It was recorded for the American market in 1965 by Wayne Newton as the title track for his album \"Summer Wind\". At the time of his release, it was predicted to be as successful as his recording of \"Red Roses for a Blue Lady\", which had reached tenth place on the Top 40 and the number one spot on the Easy Listening chart. However it only reached the 86th position. It was also recorded that year by both Bobby Vinton, and Perry Como. Como's version was recorded in Nashville in 1965 and was one of only seven tracks he worked on with Anita Kerr and her singers.", "\"White Christmas\" is a 1942 Irving Berlin song reminiscing about an old-fashioned Christmas setting. The version sung by Bing Crosby is the world's best-selling single with estimated sales in excess of 50 million copies worldwide. Other versions of the song, along with Crosby's, have sold over 50 million copies. Accounts vary as to when and where Berlin wrote the song. One story is that he wrote it in 1940, in warm La Quinta, California, while staying at the La Quinta Hotel, a frequent Hollywood retreat also favored by writer-director-producer Frank Capra, although the Arizona Biltmore also claims the song was written there. He often stayed up all night writing\u2014he told his secretary, \"Grab your pen and take down this song. I just wrote the best song I've ever written\u2014heck, I just wrote the best song that anybody's ever written!\"", "His version of \"White Christmas\" brought calls from the song's composer Irving Berlin to have the song, and the entire album, banned from radio airplay. Berlin thought Elvis's rendition a \"profane parody of his cherished yuletide standard\". Most US radio stations ignored Berlin's request, though at least one DJ was fired for playing a tune from the album. As of 2007, \"Elvis' Christmas Album\" is the top-selling holiday release of all time with 9 million in sales, according to the RIAA. \"Rudolph the Red-Nosed Reindeer\" was composed in 1948 by Johnny Marks after a 1939 poem by Robert L. May who created Rudolph as part of his employment with Montgomery Ward. The song tells the story of a reindeer whose shiny red nose guides Santa's sleigh through the fog on Christmas Eve. Gene Autry's 1949 recording remained at #1 for a week and brought the song widespread fame. Only \"White Christmas\" has sold more copies.", "All of this happens against the backdrop of a deteriorating world, which is beset by superstorms, earthquakes and wars that destroy cities and destabilize countries. It is the beginning of the Unraveling. This leads to a showdown between science and magic, which jeopardizes Patricia and Laurence's relationship. The story ends with the pair reconciling their differences and combining science and magic to stop the Unraveling. Anders' first novel, \"Choir Boy\", was published in 2005. Most of it was written in 2001, and she described it as \"very weird literary\" fiction. After that she worked on several novels, including \"All the Birds in the Sky\", but it was not until her science fiction novelette \"Six Months, Three Days\" won her a Hugo, that she realized what readers were after, and focused on \"All the Birds\". In a 2016 interview in the science fiction book podcast \"Geek's Guide to the Galaxy\", Anders said that, whereas the other books she was working on \"felt like something that other people could have written\", \"All the Birds\" \"felt like something only I could have written.\" She spent most of 2011 working on the book. Tor Books acquired \"All the Birds in the Sky\" in March 2014, with publication planned for 2015."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[178, 191], [187, 191], [41, 45], [78, 82], [60, 64], [374, 378], [40, 44], [23, 27], [539, 543], [511, 515]], "rd_topk": 1}, "test_2055": {"question": "Who is the chief economic advisor of India", "answer": ["Arvind Subramanian"], "prediction": ["Subhash Chandra Garg", "Arvind Subramanian", "Rajiv Mishra,", "Arvind Virmani", "Kamal Nath", "Krishnamurthy Subramanian", "Manmohan Singh,", "Prajapati Trivedi", "Deepak Mohanty", "Rakesh Mohan"], "score": [87.91368865966797, 86.62095642089844, 86.25912475585938, 85.81300354003906, 84.91331481933594, 84.70193481445312, 84.64555358886719, 84.46339416503906, 83.20106506347656, 83.0081787109375], "title": [["Subhash Chandra Garg"], ["Arvind Subramanian"], ["7th Central Pay Commission (CPC) and Defence Forces"], ["Arvind Virmani"], ["St. Petersburg International Economic Forum"], ["Krishnamurthy Subramanian"], ["P. V. Narasimha Rao"], ["Prajapati Trivedi"], ["Deepak Mohanty"], ["Rakesh Mohan"]], "evidence": ["Subhash Chandra Garg (IAST: ) (born 16 October 1960) is a 1983 batch IAS officer of Rajasthan cadre. He's the current Economic Affairs Secretary of India. He has also served as an Executive Director in the World Bank. Garg has graduate degrees in Law (LLB) and Commerce (BCom) from Rajasthan University. Garg is a professionally qualified Cost and Works Accountant. In addition, Garg is a qualified Company Secretary. Garg has served in various key positions for both the Union Government and the Government of Rajasthan, like as Principal Secretary (Finance), Commissioner (Investment and NRIs) Secretary (Budget), Secretary (Expenditure), Managing Director of Rajasthan State Road Transport Corporation (RSRTC), Managing Director of Rajasthan State Seeds Corporation (RSSCL), Special Secretary (Mines and Energy) and Chief Executive and Director of Rajasthan Energy Development Corporation (REDC), Registrar of University of Rajasthan, and as the District Magistrate and Collector of Rajsamand district in the Government of Rajasthan, and as the Union Economic Affairs Secretary, Additional Secretary in the Cabinet Secretariat, Joint Secretary in the Department of Expenditure of Ministry of Finance, Joint Secretary in the Department of Agriculture and Cooperation in the Ministry of Agriculture and Farmers Welfare and as a Director in the Department of Economic Affairs in the Ministry of Finance in the Union Government.", "Arvind Subramanian is an Indian economist and the former Chief Economic Adviser to the Government of India, having taken charge of the position on 16 October 2014 to 20 June 2018 succeeding Raghuram Rajan. The post of CEA was lying vacant for over a year since Raghuram Rajan left the finance ministry to join the RBI as governor in September 2013. He served as the Dennis Weatherstone Senior Fellow at the Peterson Institute for International Economics and a Senior Fellow at the Center for Global Development, both located in Washington DC. Formerly an economist at the International Monetary Fund, he is a widely cited expert on the economics of India, China, and the changing balance of global economic power. Arvind Subramanian is the author of two books, \"India's Turn: Understanding the Economic Transformation\" published in 2008, \"Eclipse: Living in the Shadow of China's Economic Dominance\" published in September 2011, and co-author of \"Who Needs to Open the Capital Account?\" which was published in 2012.", "The commission consisted of three members, and one member secretary. The 1st CPC (1947) had no member secretary. Since then all pay commissions have had a member secretary, usually from the IAS. 7CPC had a secretariat of 18 government officials on deputation from their respective departments to the commission. In addition, the commission hired 16 consultants to advice it on its work. The consultants are not named in the report, and their contribution are not documented. The secretariat was composed of members of Indian Administrative Service (IAS), Indian Postal service, Indian Railway Accounts Service, Indian Post and Telegraph Accounts and Finance Service. Senior officials involved in the preparation of the report were: Jayant Sinha, Indian Audit and Accounts Service (IA&AS), 1990 batch, (who on completion of his tenure in the 7th CPC was posted in the Department of Defence, Ministry of Defence); Ms Yashashri Shukla, Indian Post and Telegraph Accounts and Finance Service', Mudit Mittal, Indian Railway Accounts Service; Samir Kumar Sinha, IAS officer of Bihar cadre and Rajiv Mishra, 'Advisor' and 'economist'.", "Arvind Virmani is an Indian economist who was appointed India's representative to the International Monetary Fund in 2009. Prior to that, he was the Chief Economic Advisor to the Government of India. Arvind Virmani attended The Doon School. He later graduated with a degree in Economics from the St. Stephen's College, Delhi and from California Institute of Technology, following, graduated with a doctorate in economics from Harvard University. He has been an advisor to the Indian Government at the highest levels, including as Principal Advisor, Planning Commission and Chief Economic Advisor, Ministry of Finance. During his period as the Chief Economic Advisor to the Government of India, Virmani wrote the Economic survey of India (2008-2009). In 2009, he was appointed as India's representative in the International Monetary Fund, a position that is often considered to be a reward for bureaucrats who are coming close to retirement and that has a three-year period of office. He published several articles in the areas of Macroeconomics, growth and finance, International trade & Tariffs and International relations. His books include The Sudoku of India\u2019s Growth, From Uni-polar To Tri polar World: Multi-polar Transition Paradox, Propelling India From Socialist Stagnation To Global Power.", "The Forum was held on June 13\u201315, 2006 and was attended by Russian Federation President Vladimir Putin, First Deputy Prime Minister Sergey Ivanov, Foreign Minister Sergey Lavrov, Finance Minister Alexey Kudrin, Minister of Economic Development and Trade Herman Gref, and many others. Among the international guest speakers were IMF First Deputy managing director Anne Krueger, India\u2019s Minister of Trade and Industry Kamal Nath, China\u2019s Chairman of the Committee on Development and Reform Ma Kai, and Brazil's Minister of Development, Industry and Foreign Trade Luiz Fernando Furlan. The main theme of the 10-year anniversary Forum was \"Challenges of Globalization and the Competitive Advantages of Developing Countries\". The organizers provided participants an opportunity to discuss the most urgent issues of the world economy: common development trends in Brazil, Russia, India and China \u2014 countries which in recent years have become world leaders in terms of economic growth \u2014 as well as trends and prospects for the development of Russia's economy. The ceremonial presentation of the Global Energy Awards was followed by a discussion on the most critical problems in the energy sector. The Lenexpo Exhibition Centre, which has all the necessary infrastructure for top-level plenary sessions, roundtables and exhibitions, became the new SPIEF venue.", "Krishnamurthy Subramanian is an Indian economist and current Chief Economic Adviser to the Government of India (CEA), officially being appointed to the position on 7December 2018. The post of CEA was vacant for over fivemonths since the 16thCEA, Arvind Subramanian, left due to personal reasons in June 2018, having occupied the position for a few months more than the usual term of threeyears. Subramanian is a Master of Business Administration and Doctor of Philosophy (PhD) in financial economics from Booth School of Business, University of Chicago. His PhD was done under Luigi Zingales and Raghuram Rajan. He is an alumnus of Indian Institute of Technology Kanpur in electrical engineering. He is also an alumnus of the Indian Institute of Management Calcutta. He was awarded an Ewing Marion Kauffman Foundation Dissertation Fellowship in 2005.", "Narasimha Rao fought and won elections from different parts of India such as Andhra Pradesh, Maharashtra and Odisha. Adopted to avert impending 1991 economic crisis, the reforms progressed furthest in the areas of opening up to foreign investment, reforming capital markets, deregulating domestic business, and reforming the trade regime. Rao's government's goals were reducing the fiscal deficit, Privatization of the public sector and increasing investment in infrastructure. Trade reforms and changes in the regulation of foreign direct investment were introduced to open India to foreign trade while stabilising external loans. Rao wanted I.G. Patel as his Finance Minister. Patel was an official who helped prepare 14 budgets, an ex-governor of Reserve Bank of India and had headed The London School of Economics. But Patel declined. Rao then chose Manmohan Singh for the job. Manmohan Singh, an acclaimed economist, played a central role in implementing these reforms.", "Dr. Prajapati Trivedi (born August 1953) is an Indian economist. Trivedi is currently Director of Economic, Youth and Sustainable Development Directorate (EYSD) at the Commonwealth Secretariat in London, UK. In addition, he is a Visiting Fellow at the IBM Center for The Business of Government, Washington, DC, and visiting Economics Faculty at the Harvard Kennedy School of Government, Harvard University. Until January 2018, he was the Senior Fellow (Governance) and Adjunct Professor of Public Policy and Faculty Chair for the Management Programme in Public Policy (MPPP) at the Indian School of Business. He previously served as a Secretary to the Government of India. In January 2009, he was appointed as the first Secretary pf Performance Management. Based in the Cabinet Secretariat with the responsibility of managing government performance, he reviewed and reported to the Cabinet Secretary/Prime Minister on the performance of all government departments. He also headed the National Authority for Chemical Weapons Convention as its chairman. Dr. Trivedi worked for fourteen years (1994-2009) as a Senior Economist for the World Bank in Washington, DC, before joining the Government of India in 2009. He was previously Economic Adviser to Government of India from 1992 to 1994. In 2017 he became the first Indian to receive the International Public Administration Award given by the American Society for Public Administration for contributing significantly to the field of public administration as a scholar and practitioner. He is also the first Indian to be elected a Fellow of the National Academy of Public Administration (NAPA), Washington, DC Trivedi has authored the following books:", "Deepak Mohanty (Odia: \u0b26\u0b3f\u0b2a\u0b15 \u0b2e\u0b39\u0b3e\u0b28\u0b4d\u0b24\u0b3f) is an economist at India's central bank, the Reserve Bank of India (RBI). He holds the post of Executive Director at the head office of RBI in Mumbai. The areas supervised by him are monetary policy, economic research, and statistics. He has also worked in various positions in economic research and monetary policy departments of the RBI. He served in the International Monetary Fund (IMF) as senior adviser. He has graduated with a bachelor's degree in economics with honors from Ravenshaw College, Cuttack, in 1979, before going to Jawaharlal Nehru University for his master's degree. He also holds a master's degree in economics from Yale University. His current research interest includes monetary economics and international macroeconomics.", "Rakesh Mohan (born 1948) is an Indian economist and former Deputy Governor of Reserve Bank of India. He is the Vice Chairperson of Indian Institute for Human Settlements. He was appointed in November 2012 as an Executive Director of the IMF for a three-year term, and in April 2010, he joined Nestle India, as a non-executive director. He remained an adviser to numerous ministries in Government of India, including industry, and finance, and later became an important part of Indian economic reforms in the 1990s, and his report under the 'Rakesh Mohan Committee on Infrastructure', became a \"landmark document in the evolution of thinking on economic policy issues\". He is the Professor in the Practice of International Economics of Finance, Yale School of Management, and Senior Fellow, Jackson Institute for Global Affairs at Yale University and will shortly be taking over as India's Executive Director at the International Monetary Fund, Washington DC, USA."], "em_top1": false, "em_top10": true, "f1_top1": 0, "f1_top10": 1.0, "se_pos": [[0, 20], [0, 18], [1087, 1100], [0, 14], [416, 426], [0, 25], [882, 897], [4, 21], [0, 14], [0, 12]], "rd_topk": 1}, "test_2056": {"question": "When did Michael Jordan return to the NBA", "answer": ["2001", "1995", "in March 1995", "March 1995"], "prediction": ["March 1995", "January 19, 2000", "2000", "1995", "September 25, 2001", "1984", "2001", "March 1995", "1995", "2006"], "score": [84.95419311523438, 84.59406280517578, 83.1866455078125, 82.67282104492188, 80.03883361816406, 79.64578247070312, 79.40818786621094, 79.28080749511719, 78.9636001586914, 78.33051300048828], "title": [["Michael Jordan"], ["Michael Jordan"], ["Michael Jordan"], ["Michael Jordan"], ["Michael Jordan"], ["Michael Jordan"], ["1997\u201398 NBA season"], ["1993 NBA Finals"], ["Indiana Pacers"], ["Anthony Parker"]], "evidence": ["Jordan played three seasons for coach Dean Smith at the University of North Carolina. As a freshman, he was a member of the Tar Heels' national championship team in 1982. Jordan joined the Bulls in 1984 as the third overall draft pick. He quickly emerged as a league star and entertained crowds with his prolific scoring. His leaping ability, demonstrated by performing slam dunks from the free throw line in Slam Dunk Contests, earned him the nicknames Air Jordan and His Airness. He also gained a reputation for being one of the best defensive players in basketball. In 1991, he won his first NBA championship with the Bulls, and followed that achievement with titles in 1992 and 1993, securing a \"three-peat\". Although Jordan abruptly retired from basketball before the beginning of the 1993\u201394 NBA season, and started a new career in Minor League Baseball, he returned to the Bulls in March 1995 and led them to three additional championships in 1996, 1997, and 1998, as well as a then-record 72 regular-season wins in the 1995\u201396 NBA season. Jordan retired for a second time in January 1999, but returned for two more NBA seasons from 2001 to 2003 as a member of the Wizards.", "With Phil Jackson's contract expiring, the pending departures of Scottie Pippen and Dennis Rodman looming, and being in the latter stages of an owner-induced lockout of NBA players, Jordan retired for the second time on January 13, 1999. On January 19, 2000, Jordan returned to the NBA not as a player, but as part owner and president of basketball operations for the Washington Wizards. Jordan's responsibilities with the Wizards were comprehensive. He controlled all aspects of the Wizards' basketball operations, and had the final say in all personnel matters. Opinions of Jordan as a basketball executive were mixed. He managed to purge the team of several highly paid, unpopular players (such as forward Juwan Howard and point guard Rod Strickland), but used the first pick in the 2001 NBA draft to select high schooler Kwame Brown, who did not live up to expectations and was traded away after four seasons.", "With Phil Jackson's contract expiring, the pending departures of Scottie Pippen and Dennis Rodman looming, and being in the latter stages of an owner-induced lockout of NBA players, Jordan retired for the second time on January 13, 1999. On January 19, 2000, Jordan returned to the NBA not as a player, but as part owner and president of basketball operations for the Washington Wizards. Jordan's responsibilities with the Wizards were comprehensive. He controlled all aspects of the Wizards' basketball operations, and had the final say in all personnel matters. Opinions of Jordan as a basketball executive were mixed. He managed to purge the team of several highly paid, unpopular players (such as forward Juwan Howard and point guard Rod Strickland), but used the first pick in the 2001 NBA draft to select high schooler Kwame Brown, who did not live up to expectations and was traded away after four seasons.", "Jordan played three seasons for coach Dean Smith at the University of North Carolina. As a freshman, he was a member of the Tar Heels' national championship team in 1982. Jordan joined the Bulls in 1984 as the third overall draft pick. He quickly emerged as a league star and entertained crowds with his prolific scoring. His leaping ability, demonstrated by performing slam dunks from the free throw line in Slam Dunk Contests, earned him the nicknames Air Jordan and His Airness. He also gained a reputation for being one of the best defensive players in basketball. In 1991, he won his first NBA championship with the Bulls, and followed that achievement with titles in 1992 and 1993, securing a \"three-peat\". Although Jordan abruptly retired from basketball before the beginning of the 1993\u201394 NBA season, and started a new career in Minor League Baseball, he returned to the Bulls in March 1995 and led them to three additional championships in 1996, 1997, and 1998, as well as a then-record 72 regular-season wins in the 1995\u201396 NBA season. Jordan retired for a second time in January 1999, but returned for two more NBA seasons from 2001 to 2003 as a member of the Wizards.", "On September 25, 2001, Jordan announced his return to the NBA to play for the Washington Wizards, indicating his intention to donate his salary as a player to a relief effort for the victims of the September 11 attacks. In an injury-plagued 2001\u201302 season, he led the team in scoring (22.9 ppg), assists (5.2 apg), and steals (1.42 spg). However, torn cartilage in his right knee ended Jordan's season after only 60 games, the fewest he had played in a regular season since playing 17 games after returning from his first retirement during the 1994\u201395 season. Jordan started 53 of his 60 games for the season, averaging 24.3 points, 5.4 assists, and 6.0 rebounds, and shooting 41.9% from the field in his 53 starts. His last seven appearances were in a reserve role, in which he averaged just over 20 minutes per game.", "Jordan played three seasons for coach Dean Smith at the University of North Carolina. As a freshman, he was a member of the Tar Heels' national championship team in 1982. Jordan joined the Bulls in 1984 as the third overall draft pick. He quickly emerged as a league star and entertained crowds with his prolific scoring. His leaping ability, demonstrated by performing slam dunks from the free throw line in Slam Dunk Contests, earned him the nicknames Air Jordan and His Airness. He also gained a reputation for being one of the best defensive players in basketball. In 1991, he won his first NBA championship with the Bulls, and followed that achievement with titles in 1992 and 1993, securing a \"three-peat\". Although Jordan abruptly retired from basketball before the beginning of the 1993\u201394 NBA season, and started a new career in Minor League Baseball, he returned to the Bulls in March 1995 and led them to three additional championships in 1996, 1997, and 1998, as well as a then-record 72 regular-season wins in the 1995\u201396 NBA season. Jordan retired for a second time in January 1999, but returned for two more NBA seasons from 2001 to 2003 as a member of the Wizards.", "The 1997\u201398 NBA season was the 52nd season of the National Basketball Association. The season ended with the Chicago Bulls winning their third straight championship and sixth in the last eight years, beating the Utah Jazz 4 games to 2 in the 1998 NBA Finals. It also marked the departure of Michael Jordan and the end of the dynasty for the Chicago Bulls before Jordan returned in 2001 for the Washington Wizards. This was the last time that both NBA and NHL regular seasons ended on the same day. Notes", "| align=\"left\" | || 6 || 6 || 41.8 || .508 || .526 || 1.000 || 1.8 || 5.0 || 0.8 || 0.2 || 13.5 | align=\"left\" | || 6 || 0 || 27.0 || .475 || .667 || .778 || 3.0 || 2.5 || 0.3 || 0.0 || 8.8 A month after the Bulls' third straight championship, Michael Jordan's father, James R. Jordan, Sr., was murdered. Distraught by the murder of his father, Jordan announced his retirement from basketball a few weeks before the 1993\u201394 NBA season began, citing a loss of desire to play basketball. Even without Jordan, the Bulls still managed to win 55 games behind the All-Star efforts of Scottie Pippen; however the loss of Jordan was steep to overcome, and following a controversial call that gave the New York Knicks a win in Game 5, the Bulls lost to Knicks in the conference semi-finals of the 1994 NBA Playoffs in Game 7. Jordan returned from retirement in March 1995, following a brief baseball career and made the 1995 NBA Playoffs, losing to the Orlando Magic in six games.", "Market Square Arena was home of the Indiana Pacers from 1974 to 1999. The first Pacers basketball game ever held in the arena was a preseason game against the Milwaukee Bucks; attendance was 16,929. The first regular-season ABA game in the arena was held on October 18, 1974, against the San Antonio Spurs; the Pacers lost in double overtime, 129\u2013121 in front of 7,473 fans. The first Pacers victory in Market Square Arena came on October 23 with a 122\u2013107 win over the Spirits of St. Louis. The 1974\u201375 season ended for the Pacers with the ABA Finals played in Market Square Arena and Freedom Hall against their archrivals, the Kentucky Colonels. The Colonels defeated the Pacers in that championship series, winning the ABA title in five games (4 wins to 1). The 1975\u201376 Pacers won their final home ABA game in Market Square Arena with a 109\u201395 victory against the Colonels. (Kentucky won the next game by one point to win the series and advance, ending the Pacers' ABA tenure.) The Pacers continued to play in Market Square Arena after they joined the NBA. Michael Jordan's return to the Chicago Bulls after his first retirement took place at Market Square Arena in a loss to the Pacers on March 19, 1995. The final Pacers game to be played in Market Square Arena was a pre-season exhibition game against the Utah Jazz on October 23, 1999.", "After returning to the NBA as a free agent in 2006, Parker was the Toronto Raptors' starting shooting guard. In his first season with the Raptors, Parker helped the team clinch their first ever division title, first NBA Playoffs berth in five years, and best regular season record in franchise history. He helped the Raptors reach the playoffs again in the 2007\u201308 season, before becoming a free agent in 2009. On June 27, 2012, Anthony Parker retired after playing nine seasons in the NBA, five seasons in Israel, and one season in Italy. He is currently a scout for the Orlando Magic. On August 8, 2017 he was named the general manager of the Lakeland Magic."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[889, 899], [241, 257], [253, 257], [895, 899], [3, 21], [198, 202], [381, 385], [852, 862], [1203, 1207], [46, 50]], "rd_topk": 2}, "test_2057": {"question": "When did slave to the rhythm come out", "answer": ["2010", "May 8 , 2014"], "prediction": ["1985", "Autumn 1985", "28 October 1985", "1985", "13 August 1993", "1985", "1985", "30 March 1992", "1956", "19 January 2015"], "score": [81.75381469726562, 80.65422058105469, 77.95437622070312, 77.52508544921875, 76.87030029296875, 75.83676147460938, 75.36773681640625, 74.98480224609375, 74.70272827148438, 74.38583374023438], "title": [["Slave to the Rhythm (Grace Jones song)"], ["Slave to the Rhythm (Grace Jones song)"], ["Slave to the Rhythm (album)"], ["Slave to the Rhythm (Grace Jones song)"], ["Slave to the Music (Twenty 4 Seven song)"], ["Jones the Rhythm"], ["Slave to the Rhythm (album)"], ["Rhythm Is a Dancer"], ["Get Rhythm"], ["The Rhythm"]], "evidence": ["\"Slave to the Rhythm\" is a 1985 hit song performed by Grace Jones. \"Slave to the Rhythm\" was the first single from Grace Jones' album of the same name, which was released in 1985. The song and the album were written by Bruce Woolley, Simon Darlow, Stephen Lipson and Trevor Horn and produced by Horn. This was Grace's first album in three years, and it contained eight variations of the same song (the single's B-side is another variation, yet to be released on CD). \"Slave to the Rhythm\" was originally intended for Frankie Goes to Hollywood as a follow-up to their hit debut single \"Relax\". The song was assembled and produced by Horn after \"Two Tribes\", but the project was given to Jones. Paul Morley says Horn worked on the song endlessly and had hoped it would become one of his biggest and most successful creations.", "The song's lyrics are interpreted in various ways; as telling about slavery in Afro-American history (\"Axe to wood in ancient time/Man machine, power line/Fires burn, hearts beat strong/Sing out loud the chain gang song.\") or referring to the music industry and its exploitation of musicians. \"Slave to the Rhythm\" was released in Autumn 1985 to a great commercial success. The single became one of Jones' greatest commercial successes and is considered to be one of her signature tunes. It became one of the biggest chart successes for the singer in the UK (number 12, next to \"Pull Up to the Bumper\"). The track proved exceptionally popular in Belgium, New Zealand, Italy and German speaking countries, where it made it to the top 10. The original version of the single, and its remixes, also topped the American dance chart in February 1986, despite not entering the mainstream \"Billboard\" Hot 100 ranking. \"Slave to the Rhythm\" was proclaimed the best single of 1985 by \"The Face\" magazine. In 1994 a newly remixed version of the song reached the top 40 in the UK charts.", "Slave to the Rhythm is the seventh studio album by Grace Jones, released on 28 October 1985 by Island Records. Subtitled \"a biography\" in the liner notes, \"Slave to the Rhythm\" is a concept album, produced by ZTT Records founder and producer Trevor Horn, that went on to become one of Jones' most commercially successful albums and spawned her biggest hit, \"Slave to the Rhythm\". After finishing sessions at Compass Point for her \"Living My Life\" album in late 1982, Jones took a break from recording music and focused on an acting career. Within two years, she made her debut as an actress in the 1984 film \"Conan the Destroyer\", where she played alongside Arnold Schwarzenegger. She later appeared in the James Bond film \"A View to a Kill\" as the villain May Day. After finishing filming in late 1984 she returned to the studio to work on a follow-up, ending an almost three-year-long hiatus.", "\"Slave to the Rhythm\" is a 1985 hit song performed by Grace Jones. \"Slave to the Rhythm\" was the first single from Grace Jones' album of the same name, which was released in 1985. The song and the album were written by Bruce Woolley, Simon Darlow, Stephen Lipson and Trevor Horn and produced by Horn. This was Grace's first album in three years, and it contained eight variations of the same song (the single's B-side is another variation, yet to be released on CD). \"Slave to the Rhythm\" was originally intended for Frankie Goes to Hollywood as a follow-up to their hit debut single \"Relax\". The song was assembled and produced by Horn after \"Two Tribes\", but the project was given to Jones. Paul Morley says Horn worked on the song endlessly and had hoped it would become one of his biggest and most successful creations.", "\"Slave to the Music\" is a song by the Dutch Eurodance group Twenty 4 Seven. It was released on 13 August 1993, as the third single and first song from their second studio album \"Slave To The Music\". The song charted all over European countries, and it topped the international charts as well in Australia. It became a significant worldwide hit during the summer of 1993. The song was released in the U.S., and made the \"Billboard\" Hot Dance and Bubbling Under charts. It reached the Top 5 in Australia in 1994 and was certified platinum by ARIA, peaking at number 2 on the Australian Singles Chart. The music video for the song was released in September 1993 by Garcia Media Production, a studio company of Garcia Media based in Amsterdam, the Netherlands. It was videoed by Fernando Garcia and Steve Walker. The video features scenes with a jumping toad and a dancing boy called Dion, the scene shows Stay-C & Nance singing. The music video contains different coloured backgrounds. During the making a green screen was used..", "\"Jones the Rhythm\" is the second single from Grace Jones' album \"Slave to the Rhythm\", which was released in 1985. \"Jones the Rhythm\" was the opening track on the album and was one of the eight variations on the \"Slave to the Rhythm\" theme, this one more rock-influenced and dramatic than the hit single version, featuring the Ambrosian Singers and symphonic orchestration, effectively serving as the ouverture to the audio-biography. The song includes a spoken introduction by Ian McShane, reciting a passage from Jean-Paul Goude's biography \"Jungle Fever\", which was in parts used for the \"Slave to the Rhythm\" music video.", "Slave to the Rhythm is the seventh studio album by Grace Jones, released on 28 October 1985 by Island Records. Subtitled \"a biography\" in the liner notes, \"Slave to the Rhythm\" is a concept album, produced by ZTT Records founder and producer Trevor Horn, that went on to become one of Jones' most commercially successful albums and spawned her biggest hit, \"Slave to the Rhythm\". After finishing sessions at Compass Point for her \"Living My Life\" album in late 1982, Jones took a break from recording music and focused on an acting career. Within two years, she made her debut as an actress in the 1984 film \"Conan the Destroyer\", where she played alongside Arnold Schwarzenegger. She later appeared in the James Bond film \"A View to a Kill\" as the villain May Day. After finishing filming in late 1984 she returned to the studio to work on a follow-up, ending an almost three-year-long hiatus.", "\"Rhythm Is a Dancer\" is a song by the German group Snap! from their second studio album \"The Madman's Return\" (1992). Written by Benito Benites, John \"Virgo\" Garrett III (aliases for German producers Michael M\u00fcnzing and Luca Anzilotti) and Thea Austin, the song was released as the second single from the \"The Madman's Return\" album on 30 March 1992. \"Rhythm Is a Dancer\" achieved huge success in many countries around the world, topping the charts in France, Ireland, Italy, Netherlands, Germany and the United Kingdom. It also reached the top-five on the US \"Billboard\" Hot 100 and number one on the Dance Club Songs chart. It spent six weeks at the top of the UK Singles Chart, becoming the second biggest-selling single of 1992, surpassed only by Whitney Houston's version of \"I Will Always Love You\".", "\"Get Rhythm\" is a song written and recorded by American singer-songwriter and musician Johnny Cash. It was originally released as the B-side to the single release \"I Walk the Line\" in 1956 on Sun 241. It was re-released with overdubbed \"live\" effects in September 1969 as an A-side single and reached number 60 on the Billboard Pop chart. The song is about optimism, centering on a shoeshine boy who \"gets rhythm\" to cope with the tedious nature of his job. Alice Randall in the book \"My Country Roots: The Ultimate MP3 Guide to America's Original Outsider Music\" asks the question, \"racist, racialist, or race appreciating? You decide. Maybe the grinning \"boy\" hides something worth knowing in his mask as well as behind his mask.\"", "\"The Rhythm\" is a song by British singer MNEK. The song was released in the United Kingdom on 19 January 2015 as a digital download, as the third and final single from his debut extended play \"Small Talk\". The song has peaked to number 38 on the UK Singles Chart. A music video to accompany the release of \"The Rhythm\" was first released onto YouTube on 12 February 2015 at a total length of four minutes and fifteen seconds."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[27, 31], [331, 342], [76, 91], [174, 178], [95, 109], [109, 113], [87, 91], [336, 349], [184, 188], [94, 109]], "rd_topk": 4}, "test_2058": {"question": "Who wins the final fight in real steel", "answer": ["Zeus"], "prediction": ["Zeus", "Atom", "Atom", "Zeus", "Rocky", "Snake", "Union Cane", "Tommy", "Lang", "Adonis Creed"], "score": [81.8765869140625, 77.01412963867188, 75.3658676147461, 74.66560363769531, 74.53144836425781, 74.46875, 73.8599853515625, 73.26725006103516, 72.93028259277344, 72.64486694335938], "title": [["Real Steel"], ["Real Steel"], ["Real Steel"], ["Real Steel"], ["Rocky II"], ["Metal Gear Solid 4: Guns of the Patriots"], ["Rocky V"], ["Rocky Balboa"], ["Rocky III"], ["Ivan Drago"]], "evidence": ["This upsets Max, and when Charlie tries to convince him that living without him is better for Max, Max says he always wanted Charlie to fight for him and be there as a father. After Max leaves, Charlie returns to Bailey. While talking with her about the events, the two kiss, revealing their attraction to each other. Persuaded by Bailey, Charlie arranges the challenge offered by Max and convinces Debra to allow Max to witness the fight. Zeus starts the fight by knocking Atom down with its first punch, but Atom gets up, and Zeus continues its assault, knocking Atom down multiple times. However, each time Atom gets back up, and eventually is able to land its first punch allowing Atom to survive the first round. Ricky, who had made a bet with a friend of Charlie's of $100,000 that Atom would not last the round, tries to slip away, but is cornered by the fight's bookmakers. The fight continues with Atom landing multiple punches but also getting knocked down many times and recovering each time. Late in the fourth round, Atom's vocal-respond controls are damaged, forcing Charlie to use its visual \"shadow function\" to make it visually mimic his boxing skills. This, and the fact that Zeus starts running out of power from its constant offense, tip the odds in Atom's favor, forcing Zeus' programmer to manually control it, and Max and Bailey both watch Charlie doing what he was meant to do, and are touched by seeing him literally fighting for his son. Zeus gets a sound beating, once even hitting the ground and barely avoiding losing by knockout, but survives the final round and wins the match by the judges' decision. The technologically superior machine remains undefeated, but with the humiliation of being fought to a near-loss, to which Atom is hailed the \"People's Champion\".", "This upsets Max, and when Charlie tries to convince him that living without him is better for Max, Max says he always wanted Charlie to fight for him and be there as a father. After Max leaves, Charlie returns to Bailey. While talking with her about the events, the two kiss, revealing their attraction to each other. Persuaded by Bailey, Charlie arranges the challenge offered by Max and convinces Debra to allow Max to witness the fight. Zeus starts the fight by knocking Atom down with its first punch, but Atom gets up, and Zeus continues its assault, knocking Atom down multiple times. However, each time Atom gets back up, and eventually is able to land its first punch allowing Atom to survive the first round. Ricky, who had made a bet with a friend of Charlie's of $100,000 that Atom would not last the round, tries to slip away, but is cornered by the fight's bookmakers. The fight continues with Atom landing multiple punches but also getting knocked down many times and recovering each time. Late in the fourth round, Atom's vocal-respond controls are damaged, forcing Charlie to use its visual \"shadow function\" to make it visually mimic his boxing skills. This, and the fact that Zeus starts running out of power from its constant offense, tip the odds in Atom's favor, forcing Zeus' programmer to manually control it, and Max and Bailey both watch Charlie doing what he was meant to do, and are touched by seeing him literally fighting for his son. Zeus gets a sound beating, once even hitting the ground and barely avoiding losing by knockout, but survives the final round and wins the match by the judges' decision. The technologically superior machine remains undefeated, but with the humiliation of being fought to a near-loss, to which Atom is hailed the \"People's Champion\".", "This upsets Max, and when Charlie tries to convince him that living without him is better for Max, Max says he always wanted Charlie to fight for him and be there as a father. After Max leaves, Charlie returns to Bailey. While talking with her about the events, the two kiss, revealing their attraction to each other. Persuaded by Bailey, Charlie arranges the challenge offered by Max and convinces Debra to allow Max to witness the fight. Zeus starts the fight by knocking Atom down with its first punch, but Atom gets up, and Zeus continues its assault, knocking Atom down multiple times. However, each time Atom gets back up, and eventually is able to land its first punch allowing Atom to survive the first round. Ricky, who had made a bet with a friend of Charlie's of $100,000 that Atom would not last the round, tries to slip away, but is cornered by the fight's bookmakers. The fight continues with Atom landing multiple punches but also getting knocked down many times and recovering each time. Late in the fourth round, Atom's vocal-respond controls are damaged, forcing Charlie to use its visual \"shadow function\" to make it visually mimic his boxing skills. This, and the fact that Zeus starts running out of power from its constant offense, tip the odds in Atom's favor, forcing Zeus' programmer to manually control it, and Max and Bailey both watch Charlie doing what he was meant to do, and are touched by seeing him literally fighting for his son. Zeus gets a sound beating, once even hitting the ground and barely avoiding losing by knockout, but survives the final round and wins the match by the judges' decision. The technologically superior machine remains undefeated, but with the humiliation of being fought to a near-loss, to which Atom is hailed the \"People's Champion\".", "This upsets Max, and when Charlie tries to convince him that living without him is better for Max, Max says he always wanted Charlie to fight for him and be there as a father. After Max leaves, Charlie returns to Bailey. While talking with her about the events, the two kiss, revealing their attraction to each other. Persuaded by Bailey, Charlie arranges the challenge offered by Max and convinces Debra to allow Max to witness the fight. Zeus starts the fight by knocking Atom down with its first punch, but Atom gets up, and Zeus continues its assault, knocking Atom down multiple times. However, each time Atom gets back up, and eventually is able to land its first punch allowing Atom to survive the first round. Ricky, who had made a bet with a friend of Charlie's of $100,000 that Atom would not last the round, tries to slip away, but is cornered by the fight's bookmakers. The fight continues with Atom landing multiple punches but also getting knocked down many times and recovering each time. Late in the fourth round, Atom's vocal-respond controls are damaged, forcing Charlie to use its visual \"shadow function\" to make it visually mimic his boxing skills. This, and the fact that Zeus starts running out of power from its constant offense, tip the odds in Atom's favor, forcing Zeus' programmer to manually control it, and Max and Bailey both watch Charlie doing what he was meant to do, and are touched by seeing him literally fighting for his son. Zeus gets a sound beating, once even hitting the ground and barely avoiding losing by knockout, but survives the final round and wins the match by the judges' decision. The technologically superior machine remains undefeated, but with the humiliation of being fought to a near-loss, to which Atom is hailed the \"People's Champion\".", "The night of the match arrives, and Apollo makes a public goal of beating Rocky in no more than two rounds to prove the first match going the full fifteen rounds was a fluke. Rocky, fighting right-handed to protect his eye instead of his natural southpaw, is knocked down twice by Creed and outclassed for much of the fight. As with their first fight, this match goes the full fifteen rounds, by which time Creed is well ahead on points and only needs to stay away from Balboa to win the fight by decision. However, Creed, not wanting the fight to end like it did the first time, ignores his trainer's pleas to stay back and attempts to beat Rocky by knockout. In the final round, Rocky switches back to his natural stance, and in dramatic fashion, unleashes a series of counter punches on Creed, turning the tide. Both men, exhausted, trade punches until they knock each other down. Apollo gets up on the ropes early while Rocky is on the canvas and has to make his way over. Rocky is able to will himself up on 9 while Apollo collapses from exhaustion, giving Rocky the win by knockout, making him the new heavyweight champion. Rocky then gives an impassioned speech to the crowd and holds the belt over his head with a message for his wife, who is watching the fight on TV: \"Yo, Adrian, I did it!\"", "Seizing the moment it surfaces to launch the nuke, Snake, Meryl, and Johnny board the ship via catapults. When Snake arrives at the core, he uses Otacon's robot to install a computer virus coded by Naomi and Sunny, that destroys the core AI and the entire Patriot system controlling the entire world, leaving the bare necessities for the modern civilization to survive. The destruction of the Patriots brings the war economy to a halt, counteracts the Patriots' upcoming civilian control scheme, and causes a mental breakdown for the Haven Troopers as their mind-suppression systems are disabled. Snake, after passing out in the core room, awakes atop \"Outer Haven\"'s tower to find Liquid. Liquid reveals that his plan the whole time was to have Snake himself defeat the Patriots, while Liquid drew their attention to himself. The two engage in a tough and emotional hand-to-hand battle, with Snake emerging victorious. After telling Snake a few last words, Liquid reverts back to his old identity of Revolver Ocelot and dies.", "One day, Rocky and Paulie meet a young fighter from Oklahoma named Tommy Gunn, and Rocky takes him under his wing. Training the young fighter gives Rocky a sense of purpose, and Gunn rises to become a top contender. Rocky becomes so distracted with Gunn's training that he ends up neglecting Robert, who is being bullied at school. After learning to defend himself, he falls in with the wrong crowd and becomes withdrawn and angry toward his family. Union Cane wins the vacant world heavyweight title, while Gunn continues rising through the ranks. Still wanting to do business with Rocky, Washington sees Gunn's knockout streak and relationship with Rocky as a way of gaining control of him. Washington showers Gunn with luxuries and promises him that he is the only path to a shot against Union Cane for the title. Washington hopes to take control of Gunn as his manager and keep Rocky on as head trainer.", "Rocky is still anxious as he watches the match with Tommy facing off against Union Cane on television with Paulie. As the match starts out small, Rocky begins to emote through the first couple of seconds of the fight as Cane becomes effective in hurting Tommy. As Tommy begins to make his adjustments as Rocky taught him, Rocky then mirrors his punches on a punching bag, which leaves his family concerned. Tommy wins the World Heavyweight title from Union Cane by knockout. Visibly proud of Tommy, Rocky is surprised that Tommy credited his success to Duke instead. However, Tommy is booed and ridiculed in the press, since he had never gone up against a \"real contender\" he is not regarded as a real champion or heir to the belt. This motivates Tommy, with prodding from Duke, to publicly challenge Rocky to a fight.", "Lang and Rocky meet at Philadelphia's Spectrum. In a brawl backstage, Mickey is violently shoved by Lang, causing Mickey to suffer a heart attack. Distraught, Rocky wants to call the match off, but Mickey urges him on while he stays in the dressing room. By the time of the match, Rocky is both enraged and severely distracted by his mentor's condition. The match begins with Rocky pounding Lang with several huge blows looking for an early knockout, but he cannot put Lang down due to his own lack of conditioning. The bigger, stronger, and better-prepared Lang quickly recovers and takes charge, dominating Rocky and knocking him out with a haymaker left hook in the second round, winning the heavyweight championship title. After the match, Rocky tells an exhausted Mickey that the match ended in a second round knockout without saying who the victor was. Mickey falsely believes Rocky won and then peacefully succumbs to his heart attack. Rocky, lapsing into severe depression, mourns over Mickey's death.", "After his loss to Rocky, Drago was disgraced by the USSR and Ludmilla left him to raise their son, Viktor, on his own. Following the end of the Cold War, Drago was forced to move to the Ukraine, where he lived a modest life while relentlessly training Viktor to be an even more formidable boxer than he was. In \"Creed II\", after Viktor knocks out every opponent he faces in the Ukraine, and Adonis Creed wins the World Heavyweight Championship, Drago, Viktor, and promoter Buddy Marcelle travel to Philadelphia to issue a challenge to Adonis for the title. Drago visits Rocky in his restaurant to tell him how Rocky cost him everything, and threatens to avenge his loss through Viktor, telling Rocky, \"My son will break your boy.\""], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[1464, 1468], [1270, 1274], [1756, 1760], [1194, 1198], [1062, 1067], [893, 898], [450, 460], [407, 412], [558, 562], [391, 403]], "rd_topk": 2}, "test_2059": {"question": "Who sings the wire season 5 theme song", "answer": ["Steve Earle"], "prediction": ["the Blind Boys of Alabama", "Blind Boys of Alabama", "The Blind Boys of Alabama", "Ivan Ashford", "Miyuki Sawashiro.", "Razorlight,", "Maaya Uchida", "Deirdre Lovejoy", "Solomon Burke", "Dennis Waterman"], "score": [84.40188598632812, 84.36605072021484, 81.71993255615234, 80.9281005859375, 80.41316223144531, 79.8845443725586, 79.83904266357422, 79.53221130371094, 79.45732116699219, 78.83216857910156], "title": [["The Wire"], ["The Wire"], ["The Wire"], ["Way Down in the Hole"], ["List of Arakawa Under the Bridge episodes"], ["Wire to Wire (song)"], ["Vividred Operation"], ["University of Evansville"], ["Mission Accomplished (The Wire)"], ["End of the Line (Traveling Wilburys song)"]], "evidence": ["During season finales, a song is played before the closing scene in a montage showing the lives of the protagonists in the aftermath of the narrative. The first season montage is played over \"Step by Step\" by Jesse Winchester, the second \"I Feel Alright\" by Steve Earle, the third \"Fast Train\" written by Van Morrison and performed by Solomon Burke, the fourth \"I Walk on Gilded Splinters\" written by Dr. John and performed by Paul Weller and the fifth uses an extended version of \"Way Down In The Hole\" by the Blind Boys of Alabama, the same version of the song used as the opening theme for the first season. While the songs reflect the mood of the sequence, their lyrics are usually only loosely tied to the visual shots. In the commentary track to episode 37, \"Mission Accomplished\", executive producer David Simon said: \"I hate it when somebody purposely tries to have the lyrics match the visual. It brutalizes the visual in a way to have the lyrics dead on point. ... Yet at the same time it can't be totally off point. It has to glance at what you're trying to say.\"", "During season finales, a song is played before the closing scene in a montage showing the lives of the protagonists in the aftermath of the narrative. The first season montage is played over \"Step by Step\" by Jesse Winchester, the second \"I Feel Alright\" by Steve Earle, the third \"Fast Train\" written by Van Morrison and performed by Solomon Burke, the fourth \"I Walk on Gilded Splinters\" written by Dr. John and performed by Paul Weller and the fifth uses an extended version of \"Way Down In The Hole\" by the Blind Boys of Alabama, the same version of the song used as the opening theme for the first season. While the songs reflect the mood of the sequence, their lyrics are usually only loosely tied to the visual shots. In the commentary track to episode 37, \"Mission Accomplished\", executive producer David Simon said: \"I hate it when somebody purposely tries to have the lyrics match the visual. It brutalizes the visual in a way to have the lyrics dead on point. ... Yet at the same time it can't be totally off point. It has to glance at what you're trying to say.\"", "The opening theme is \"Way Down in the Hole,\" a gospel-and-blues-inspired song, written by Tom Waits for his 1987 album \"Franks Wild Years\". Each season uses a different recording and a different opening sequence, with the theme being performed by The Blind Boys of Alabama, Waits, The Neville Brothers, DoMaJe and Steve Earle. The season four version of \"Way Down in the Hole\" was arranged and recorded for the show and is performed by five Baltimore teenagers: Ivan Ashford, Markel Steele, Cameron Brown, Tariq Al-Sabir and Avery Bargasse. Earle, who performed the fifth season version, is also a member of the cast, playing the recovering drug addict Walon. The closing theme is \"The Fall,\" composed by Blake Leyh, who is also the music supervisor of the show.", "\"Way Down in the Hole\" is a song written by the singer-songwriter Tom Waits. It was included on his 1987 album \"Franks Wild Years\", which was later made into a stage production. The song was used as the theme for HBO's \"The Wire\". A different recording was used each season. Versions, in series order, were recorded by The Blind Boys of Alabama, Tom Waits, The Neville Brothers, DoMaJe, and Steve Earle. Season four's version, performed by the Baltimore teenagers Ivan Ashford, Markel Steele, Cameron Brown, Tariq Al-Sabir and Avery Bargasse, was arranged and recorded specifically for the show. An extended version of the Blind Boys of Alabama recording was played over a montage in the series finale.", "The first season has three theme songs, two opening themes and one ending theme. The main opening theme is by Etsuko Yakushimaru and its ending theme by Suneohair, which is also the ending theme for episode 13 of the second season. The opening theme was released as a single on May 26, 2010, and the ending theme on June 23, 2010. The opening theme for episode five is performed by Miyuki Sawashiro. The second season has three theme songs, two opening themes and one ending theme. The main opening theme is \"Cosmos vs. Alien\" by Yakushimaru while the ending theme is by Suneohair. The opening theme for episode 10 is by Ch\u014d.", "\"Wire to Wire\" is a song by Anglo-Swedish rock band Razorlight, written by singer Johnny Borrell, from their third album \"Slipway Fires\". It was officially released as the album's first single on 27 October 2008. It was released for downloads digitally, however, on 26 September. The song marked the band's fourth UK Top 5 single and their fifth to chart in the UK Top 10. It peaked at #5 in the UK Singles Chart, and #3 in Germany and Austria. The song has also peaked #8 in Swiss, #13 in Belgium (Flanders) #23 in Ireland and #71 in the Dutch singles charts. However, it underperformed in comparison to some of their previous singles and \"Slipway Fires\" is now their first album to fail to produce a top three single. It spent only 7 weeks in the UK Top 100, less than each of the first three singles from the preceding album \"Razorlight\". The song is a piano-led ballad, described as \"slow-burning\". The accompanying music video was shot by Oscar nominated feature film director Stephen Frears. The track was used as part of Burberry's introductory advertisement in its Fall/Winter 2009 collection.", "The series makes use of six pieces of theme music: one opening theme and five ending themes. The opening theme is \"Energy\" by Earthmind. The first four ending themes are used for one episode each: \"We Are One\" by Ayane Sakura and Rie Murakawa for episode two, \"Stereo Colors\" by Ayane Sakura and Yuka \u014ctsubo for episode three, \"Stray Sheep Story\" by Ayane Sakura and Aya Uchida for episode four, and by Maaya Uchida for episode five. The fifth ending theme, \"Vivid Shining Sky\" by Ayane Sakura, Rie Murakawa, Yuka \u014ctsubo, Aya Uchida and Maaya Uchida, is used for episode six and onwards.", "Sororities Fraternities Alumni include numerous prominent entertainers, sports stars, and doctors. Among them are Matt Williams, producer and writer of \"The Cosby Show\", \"Home Improvement\", and \"Roseanne\"; actor Rami Malek, Golden Globe and Emmy award winner for best drama series (Mr. Robot) and plays Freddie Mercury in Bohemian Rhapsody; Jack McBrayer, actor on \"30 Rock\"; Jerry Sloan, NBA player and Hall of Fame head coach; David Weir, Scottish international soccer player; actor on \"The Wire\", Deirdre Lovejoy; and Jim Michaels, Golden Globe nominee and NAACP Image Award winning television producer (\"Supernatural\", \"Everybody Hates Chris\").", "Solomon Burke's cover of Van Morrison's \"Fast Train\" plays over the episode's closing montage. David Simon credits co-executive producer Joe Chappelle with choosing the song. The Futon Critic named it the second best episode of 2004, saying \"Every year, \"The Wire\" builds up to a boiling point where you think the good guys will win and the bad guys will lose \u2013 and damn if every year \"The Wire\" doesn't find a new way to show that real life never works quite like that. From the demolition of its pseudo-'Amsterdam' to McNulty's realization of 'who the hell have I been chasing,' season three once again proved why this series is an American classic.\"", "\"End of the Line\" appeared in the George Harrison-produced cult comedy \"Checking Out\". A version sung by Dennis Waterman was used as the theme tune for the pilot of the BBC production \"New Tricks\". The song has also been included in TV spots for the 2004 film \"The Terminal\", as well as the trailer for the 2007 hit comedy \"Knocked Up\". Tom Petty and the Heartbreakers played this song live during their 2008 North American tour. Harrison was honoured in the parody song \"No Where Near the End of My Time\" by radio on-air personality Bob Rivers. The song was used on the end credits of the Australian family comedy film \"\" in 2016 and for an episode of HBO's \"Crashing\" in 2018."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[507, 532], [511, 532], [247, 272], [464, 476], [382, 399], [52, 63], [403, 415], [500, 515], [0, 13], [105, 120]], "rd_topk": 3}, "test_2060": {"question": "Where are the Washington Redskins based out of", "answer": ["the Washington metropolitan area", "FedExField in Landover , Maryland"], "prediction": ["Washington metropolitan area", "Landover, Maryland", "Washington", "Landover, Maryland", "Landover, Maryland", "Landover, Maryland", "Washington, D.C.", "Washington, D.C.", "Landover, Maryland", "Landover, Maryland"], "score": [90.78353881835938, 89.858642578125, 88.92504119873047, 87.97232055664062, 87.44462585449219, 87.0303955078125, 87.00807189941406, 86.996826171875, 86.90802001953125, 86.82708740234375], "title": [["Washington Redskins"], ["Washington Redskins"], ["Washington Redskins"], ["2012 Washington Redskins season"], ["Arts and culture of Washington, D.C."], ["2011 Washington Redskins season"], ["List of Washington Redskins players"], ["1999 Washington Redskins season"], ["Sports in Maryland"], ["NFC East"]], "evidence": ["The Washington Redskins are a professional American football team based in the Washington metropolitan area. The Redskins compete in the National Football League (NFL) as a member of the National Football Conference (NFC) East division. The team plays its home games at FedExField in Landover, Maryland; its headquarters and training facility are at Inova Sports Performance Center at Redskins Park in Ashburn, Virginia and the Redskins Complex in Richmond, Virginia, respectively. The Redskins have played more than one thousand games since their founding in , and are one of only five franchises in the NFL to record over six hundred regular season and postseason wins, reaching that mark in 2015. The Redskins have won five NFL Championships (the latter three in Super Bowls), and have captured fourteen divisional titles and six conference championships. It was the first NFL franchise with an official marching band and the first with a fight song, \"Hail to the Redskins\".", "The Washington Redskins are a professional American football team based in the Washington metropolitan area. The Redskins compete in the National Football League (NFL) as a member of the National Football Conference (NFC) East division. The team plays its home games at FedExField in Landover, Maryland; its headquarters and training facility are at Inova Sports Performance Center at Redskins Park in Ashburn, Virginia and the Redskins Complex in Richmond, Virginia, respectively. The Redskins have played more than one thousand games since their founding in , and are one of only five franchises in the NFL to record over six hundred regular season and postseason wins, reaching that mark in 2015. The Redskins have won five NFL Championships (the latter three in Super Bowls), and have captured fourteen divisional titles and six conference championships. It was the first NFL franchise with an official marching band and the first with a fight song, \"Hail to the Redskins\".", "The Washington Redskins are a professional American football team based in the Washington metropolitan area. The Redskins compete in the National Football League (NFL) as a member of the National Football Conference (NFC) East division. The team plays its home games at FedExField in Landover, Maryland; its headquarters and training facility are at Inova Sports Performance Center at Redskins Park in Ashburn, Virginia and the Redskins Complex in Richmond, Virginia, respectively. The Redskins have played more than one thousand games since their founding in , and are one of only five franchises in the NFL to record over six hundred regular season and postseason wins, reaching that mark in 2015. The Redskins have won five NFL Championships (the latter three in Super Bowls), and have captured fourteen divisional titles and six conference championships. It was the first NFL franchise with an official marching band and the first with a fight song, \"Hail to the Redskins\".", "The Washington Redskins season was the franchise's 81st season in the National Football League (NFL) and their 76th representing Washington, D.C. Their home games were played at FedExField in Landover, Maryland for the 16th consecutive season. Washington played in the Eastern division of the National Football Conference (NFC). It was the third season for head coach Mike Shanahan. The Redskins improved on their 5\u201311 record from the 2011 season, and ended the regular season with a 7-game winning streak to finish with a 10\u20136 record, leading to a NFC East division championship and a 4th seed spot in the playoffs. It was their first division title since 1999. The Redskins lost in the Wild-Card Round to the Seattle Seahawks, ending their season but marking the team's first playoff appearance since the end of the 2007 season (in which the Redskins also lost the Wild Card game to the Seahawks).", "Washington, D.C. is home to four major professional men's sports team and one major professional women's team. The Verizon Center in Washington's Chinatown is home to the Washington Wizards of the National Basketball Association (NBA), the Washington Capitals of the National Hockey League (NHL), and the Washington Mystics of the Women's National Basketball Association (WNBA). Nationals Park, which opened in Southeast Washington in 2008, is home to the Washington Nationals of Major League Baseball (MLB). RFK Stadium, which was named after U.S. Senator and presidential candidate Robert F. Kennedy, is the home of D.C. United of Major League Soccer (MLS). FedEx Field in Landover, Maryland is the home of the Washington Redskins of the National Football League (NFL). Other professional and semi-professional teams in Washington include the Washington Kastles of the World Team Tennis, the Washington, D.C. Slayers of American National Rugby League, the Baltimore Washington Eagles of the U.S. Australian Football League, the D.C. Divas of the Independent Women's Football League, and the Potomac Athletic Club RFC of the Rugby Super League.", "The Washington Redskins season was the 80th season for the team in the National Football League (NFL) and their 75th representing the District of Columbia (Washington, D.C.). Their home games were played at FedExField in Landover, Maryland for the 15th consecutive year. Washington played in the Eastern division of the National Football Conference (NFC). The Redskins failed to improve on their 2010 record of 6\u201310, but did manage to defeat the New York Giants, the eventual Super Bowl champions, twice in the regular season, becoming only the sixth team to do so (the 1969 Oakland Raiders, 1983 Seattle Seahawks, 1995 Washington Redskins, 2002 New Orleans Saints, and 2007 Dallas Cowboys, also against the Giants, being the others).", "This is a list of American football players who have played for the Washington Redskins, as well as its predecessors the Boston Braves (1932) and Boston Redskins (1933\u20131936), in the National Football League (NFL). It includes players that have played at least five games in the NFL regular season. The Washington Redskins franchise was founded in Boston, Massachusetts as the Boston Braves, named after the local baseball franchise. The name was changed the next year to the Redskins. In 1937, the franchise moved to Washington, D.C.", "The Washington Redskins season was the franchise's 68th season in the National Football League (NFL) and their 63rd in Washington, D.C. The team improved on their 6\u201310 record from 1998 to 10\u20136. They succeeded to the extent of reaching their first postseason appearance since 1992 and beating the Lions in the first week of the playoffs, before losing to the Buccaneers by a single point in the divisional playoff round. The season would also be the first for new team owner Daniel Snyder. It would be the final season that the Redskins have qualified for the playoffs in the 1990s and for the next five seasons, the team fell out of contention. They returned to the playoffs in 2005. The New Orleans Saints traded all of their draft picks to the Washington Redskins for the fifth overall selection, which they used to take running back Ricky Williams. It is the first time ever that an NFL team has had only one pick in a draft.", "Maryland has major professional sports teams in the city of Baltimore and in the Maryland suburbs of Washington, D.C.. Two major league teams play in Baltimore \u2014 the NFL's Baltimore Ravens and MLB's Baltimore Orioles. Additionally, the NFL's Baltimore Colts played in Baltimore from 1953 to 1983 before moving to Indianapolis. The Washington Redskins play in Landover, Maryland. The NHL's Washington Capitals and the NBA's Washington Wizards used to play in Maryland before moving in 1997 to a newly constructed arena in downtown D.C.", "The Philadelphia Eagles are the only NFC East team to actually play in the city of the team's naming, Philadelphia. The other three teams play in suburbs of the major cities they are named after. The Dallas Cowboys play in Arlington, Texas. The Washington Redskins play in Landover, Maryland and the New York Giants play in East Rutherford, New Jersey, where they share a stadium with the New York Jets. Somewhat analogously, all four teams in the AFC East do not play within the boundaries of their metro areas\u2019 main cities."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[79, 107], [284, 302], [79, 89], [192, 210], [675, 693], [221, 239], [530, 546], [119, 135], [359, 377], [273, 291]], "rd_topk": 1}, "test_2061": {"question": "When did the Battle of Bull run start", "answer": ["July 21 , 1861", "5 : 15 a.m."], "prediction": ["July 21, 1861", "July 21, 1861", "July 21, 1861", "July 21, 1861", "August 28", "July 21", "July 21, 1861", "July 21, 1861", "July 21, 1861", "Prince William County, Virginia"], "score": [86.97750854492188, 81.4959716796875, 81.38600158691406, 80.2442626953125, 79.30369567871094, 78.77145385742188, 78.39419555664062, 78.06111145019531, 77.96623992919922, 77.46739959716797], "title": [["First Battle of Bull Run"], ["Second Battle of Bull Run"], ["First Bull Run Confederate order of battle"], ["War tourism"], ["Second Battle of Bull Run"], ["Battle of Hoke's Run"], ["P. G. T. Beauregard"], ["Battle of Fairfax Court House (June 1861)"], ["Manassas National Battlefield Park"], ["First Battle of Bull Run"]], "evidence": ["The First Battle of Bull Run (the name used by Union forces), also known as the First Battle of Manassas (the name used by Confederate forces), was fought on July 21, 1861 in Prince William County, Virginia, just north of the city of Manassas and about 25 miles west-southwest of Washington, D.C. It was the first major battle of the American Civil War. The Union's forces were slow in positioning themselves, allowing Confederate reinforcements time to arrive by rail. Each side had about 18,000 poorly trained and poorly led troops in their first battle. It was a Confederate victory, followed by a disorganized retreat of the Union forces.", "Part of the site of the battle is now Manassas National Battlefield Park. Located north of Manassas, in Prince William County, Virginia, it preserves the site of two major American Civil War battles: the First Battle of Bull Run on July 21, 1861, and the Second Battle of Bull Run which was fought between August 28 and August 30, 1862 (also known as the First Battle of Manassas and the Second Battle of Manassas, respectively). The peaceful Virginia countryside bore witness to clashes between the armies of the North (Union) and the South (Confederacy), and it was there that Confederate General Thomas J. Jackson acquired his nickname \"Stonewall.\" The Civil War Trust (a division of the American Battlefield Trust) and its partners have acquired and preserved of the Second Battle of Bull Run battlefield in more than 10 transactions since 2000.", "The following Confederate units and commanders fought in the First Battle of Bull Run on July 21, 1861. The Union order of battle is shown separately. Order of battle compiled from the army organization during the battle and the reports. BG Joseph E. Johnston, Commanding BG P. G. T. Beauregard General Staff: Headquarters Escort: BG Joseph E. Johnston General Staff:", "The First Battle of Bull Run, also known as First Manassas (the name used by Confederate forces), was fought on July 21, 1861, in Prince William County, Virginia, near the city of Manassas. It was the first major land battle of the American Civil War. Expecting an easy Union victory, the wealthy elite of nearby Washington, including congressmen and their families, had come to picnic and watch the battle. When the Union army was driven back in a running disorder, the roads back to Washington were blocked by panicked civilians attempting to flee in their carriages. Frank Leslie made an engraving of this in the engraving The Soldier in Our Civil War. The Battle of Gettysburg was also spectated by a number of tourists.", "The Second Battle of Bull Run began on August 28 as a Federal column, under Jackson's observation just outside Gainesville, near the farm of the John Brawner family, moved along the Warrenton Turnpike. It consisted of units from Brig. Gen. Rufus King's division: the brigades of Brig. Gens. John P. Hatch, John Gibbon, Abner Doubleday, and Marsena R. Patrick, marching eastward to concentrate with the rest of Pope's army at Centreville. King was not with his division because he had suffered a serious epileptic attack earlier that day.", "Patterson's retrograde movement took pressure off Confederate forces in the Shenandoah Valley and allowed Brig. Gen. Joseph E. Johnston's Army of the Shenandoah to march to support Brig. Gen. P.G.T. Beauregard at Manassas Junction. Following the stunning Union defeat at the First Battle of Bull Run on July 21, the Union commander at Hoke's Run, General Robert Patterson, was assigned popular blame without participating while the Confederate commander at Hoke's Run was assigned glory for his actions during the first major battle of the War; thereafter, the two commanders and two engagements, one a brief skirmish and the other a major battle, cannot be uncoupled in retroanalysis.", "The First Battle of Bull Run (First Manassas) began early on July 21, 1861, with an element of surprise for both armies\u2014 both McDowell and Beauregard planned to envelop their opponent with an attack from their right flank. McDowell struck first, crossing Bull Run and threatening Beauregard's left flank. For a while, Beauregard persisted in moving his troops for an attack on his right flank (McDowell's left, toward Centreville), but Johnston urged him to travel with him to the threatened flank at Henry House Hill, which was weakly defended. Seeing the strength of the Union attack at that point, Beauregard insisted that Johnston leave the area of immediate action and coordinate the overall battle from a position to the rear. Beauregard rallied the troops, riding among the men, brandishing regimental colors, and giving inspirational speeches. The Confederate line held.", "Several weeks later, on July 17, 1861, Union forces occupied Fairfax Court House as they began their move on Manassas Junction. The Confederates had abandoned the town in the face of the large Union force that was moving toward the first big battlefield of the war. The Union forces moved to Centreville the next day on their way to the preliminary Battle of Blackburn's Ford on July 18, 1861 and the First Battle of Bull Run (Battle of First Manassas) on July 21, 1861. Fairfax Court House and its immediate vicinity would be the scene of several small battles or skirmishes and raids during the war.", "Manassas National Battlefield Park, located north of Manassas, in Prince William County, Virginia, preserves the site of two major American Civil War battles: the First Battle of Bull Run on July 21, 1861, and the Second Battle of Bull Run which was fought between August 28 and August 30, 1862 (also known as the \"First Battle of Manassas\" and the \"Second Battle of Manassas\", respectively). The peaceful Virginia countryside bore witness to clashes between the armies of the North (Union) and the South (Confederacy), and it was there that Confederate General Thomas J. Jackson acquired his nickname \"Stonewall.\"", "The First Battle of Bull Run (the name used by Union forces), also known as the First Battle of Manassas (the name used by Confederate forces), was fought on July 21, 1861 in Prince William County, Virginia, just north of the city of Manassas and about 25 miles west-southwest of Washington, D.C. It was the first major battle of the American Civil War. The Union's forces were slow in positioning themselves, allowing Confederate reinforcements time to arrive by rail. Each side had about 18,000 poorly trained and poorly led troops in their first battle. It was a Confederate victory, followed by a disorganized retreat of the Union forces."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[158, 171], [232, 245], [89, 102], [112, 125], [39, 48], [303, 310], [61, 74], [456, 469], [191, 204], [175, 206]], "rd_topk": 7}, "test_2062": {"question": "Who is playing halftime show Super Bowl 2018", "answer": ["Justin Timberlake"], "prediction": ["Justin Timberlake", "Justin Timberlake", "Lady Gaga", "Lady Gaga", "Justin Timberlake,", "Bruno Mars", "Lady Gaga", "Lady Gaga", "Bruce Springsteen", "Justin Timberlake"], "score": [94.55534362792969, 92.02168273925781, 87.22236633300781, 87.01402282714844, 86.66119384765625, 86.39701843261719, 86.17951965332031, 84.69976806640625, 84.59485626220703, 84.58869934082031], "title": [["Super Bowl LII halftime show"], ["Super Bowl LII"], ["Super Bowl LII halftime show"], ["List of Super Bowl halftime shows"], ["Super Bowl LII"], ["Super Bowl XLVIII halftime show"], ["Super Bowl LI halftime show"], ["Super Bowl LI"], ["Super Bowl XLIII"], ["University of Minnesota Marching Band"]], "evidence": ["The Super Bowl LII Halftime Show (officially known as the Pepsi Super Bowl LII Halftime Show) took place on February 4, 2018 at U.S. Bank Stadium in Minneapolis, Minnesota, as part of Super Bowl LII. Justin Timberlake was the featured performer, as confirmed by the National Football League (NFL) on October 22, 2017. It was televised nationally by NBC. It received four nominations at the 70th Primetime Emmy Awards. The show began with Jimmy Fallon introducing Justin Timberlake, followed by a video screen depicting Timberlake performing \"Filthy\" in a club setting below the field level of the stadium. He then walked up a staircase and appeared on a ramp stage extending outward into the field, descending into a series of stages surrounded by a crowd. Timberlake proceeded to move through the crowd performing \"Rock Your Body\" with a troupe of female backup dancers, abruptly stopping short of the end of the song and shifting to \"Se\u00f1orita\" on a small stage with his backing dancers. Upon reaching the main stage, he performed a number of songs, including \"SexyBack\", \"My Love\", and \"Cry Me a River\", which featured a dance break mid-field. Upon reaching the next stage, Timberlake performed his hit song \"Suit & Tie\" as the University of Minnesota Marching Band, wearing black tuxedos, played backup instrumentals and marched out to meet him.", "Justin Timberlake headlined the Super Bowl LII halftime show, along with his band \"The Tennessee Kids\" and featuring the University of Minnesota Marching Band. Timberlake performed in two previous Super Bowls: Super Bowl XXXV in 2001 as a member of NSYNC, and Super Bowl XXXVIII in 2004 with Janet Jackson. Timberlake's performance drew criticism for not being \"spectacular\", looking to be safe and avoid incidents such as the infamous \"wardrobe malfunction\" encountered during his performance with Jackson, and for incorporating a video of Prince, who opposed performances combining the dead and the living.", "At the 70th Primetime Emmy Awards, the Super Bowl halftime show received four nominations: Outstanding Directing For A Variety Special, Outstanding Lighting Design/Lighting Direction For A Variety Special, Outstanding Music Direction, Outstanding Technical Direction, Camerawork, Video Control For A Limited Series, Movie Or Special. The Super Bowl LII halftime show was seen by 106.6 million television viewers in the United States, 9% less than Lady Gaga's in 2017. It had higher average viewership than the game itself, and the decline for the halftime show was roughly in line with that of the game as a whole, which had lost 7% compared to the previous year. According to initial sales reports from Nielsen Music, sales of the songs Timberlake performed during the halftime show gained 534% in the United States on February 4, the day of the Super Bowl, compared to Feb. 3, while his streams on Spotify gained 214%.", "Halftime shows are a tradition during American football games at all levels of competition. Entertainment during the Super Bowl, the annual championship game of the National Football League (NFL), represents a fundamental link to pop culture, which helps broaden the television audience and nationwide interest. As the Super Bowl itself is typically the most-watched event on television in the United States annually, the halftime show has been equally-viewed in recent years: the halftime show of Super Bowl XLIX featuring Katy Perry was viewed by 118.5 million, as part of an overall telecast that peaked at 120.3 million at its conclusion\u2014the most-watched television broadcast in U.S. history. The NFL claims that the Super Bowl LI halftime show, with Lady Gaga was the \"most-watched musical event of all-time,\" citing a figure of 150 million viewers based on the television audience, as well as unique viewership of video postings of the halftime show on the league's platforms, and social media interactions (a metric that was never calculated prior to 2017). However, the show was seen by 117.5 million television viewers, making it the second-highest-rated halftime show.", "The broadcast of the game on NBC had the smallest Super Bowl audience in nine years, with an average of 103.4 million viewers. Average TV viewership for the halftime show, headlined by Justin Timberlake, was 106.6 million American television viewers, 9 percent less than the previous year. On October 8, 2013, the league announced that three venues would vie to host Super Bowl LII: On May 20, 2014, the league's owners picked Minneapolis at their meeting in Atlanta, Georgia. The NFC was represented by the number-one playoff seed Philadelphia Eagles, while the AFC was represented by the number-one playoff seed New England Patriots, marking the fourth time in the previous five years that the Super Bowl had featured the top team from each conference.", "The Super Bowl XLVIII halftime show occurred on February 2, 2014 at MetLife Stadium in New Jersey as part of Super Bowl XLVIII and was headlined by American singer Bruno Mars alongside his band The Hooligans with special guests The Red Hot Chili Peppers. The show was produced by Ricky Kirshner and directed by Hamish Hamilton. At the time of airing the halftime show attracted the largest audience in the history of the Super Bowl, attracting 115.3 million viewers. The show was later surpassed by the following year's Super Bowl XLIX halftime show in which American pop star Katy Perry was headliner. The performance generated 2.2 million tweets, due to clamoring for tickets to Mars' Moonshine Jungle Tour.", "The Super Bowl LI Halftime show took place on February 5, 2017, at NRG Stadium in Houston, Texas, as part of Super Bowl LI. Lady Gaga headlined the show performing a medley of her songs, including material from her then-most recent studio album, \"Joanne\". The National Football League (NFL) confirmed the singer would helm the LI halftime show after discussions with the singer Adele proved unproductive. Gaga began rehearsing the show by January 2017 and had no guest performers. Her sister gave her the idea of performing from atop the NRG Stadium; Gaga worked on the logistics behind it. She promoted the performance by uploading short clips on her social media accounts. Fashion house Versace created the wardrobe for the show with a custom jumpsuit for the singer. Designers Bruce Rodgers and LeRoy Bennett did the show's production work with lighting designer Bob Barnhart of 22 Degrees. The stage was created by All Access Staging & Productions, which had also created previous Super Bowl halftime stages. During the introduction scene, Gaga was accompanied by a fleet of 300 drones provided by Intel, which formed an image of the American flag behind the singer. It marked the first time the drones had been used as part of a television broadcast.", "Fox's broadcast of the game averaged around 111.3 million viewers, slightly down from the 111.9 million viewers of the previous year's Super Bowl, while the total number of viewers for all or part of the game hit a record number of 172 million. Average TV viewership for the halftime show, headlined by Lady Gaga, was higher at 117.5 million. On the following day a number of media outlets immediately hailed the game as the greatest Super Bowl of all time. The NFL selected the sites for Super Bowl 50 and Super Bowl LI at the owners' spring meetings in Boston on May 21, 2013. On October 16, 2012, the NFL announced that Reliant Stadium in Houston, which was renamed NRG Stadium in 2014, was a finalist to host Super Bowl LI. Houston then competed against the runner-up for the site of Super Bowl 50: Hard Rock Stadium in Miami Gardens, Florida. The South Florida bid for either Super Bowl partially depended on whether the stadium underwent renovations. However, on May 3, the Florida Legislature refused to approve the funding plan to pay for the renovations, dealing a blow to South Florida's chances. The NFL ultimately selected Houston as the host city of Super Bowl LI.", "The Super Bowl XLIII halftime show, which was sponsored by Bridgestone for the second consecutive year, featured Bruce Springsteen and the E Street Band, with The Miami Horns and a gospel choir. Their halftime performance consisted of these songs in the following order: Each of the numbers had at least one verse removed, in order to fit the overall performance in the intended 12-minute time limit. Springsteen had turned down numerous invitations to play at the Super Bowl before this one, unsure of its legitimacy, but finally accepted after realizing the prestige value.", "On February 4, 2018, the Minnesota Marching Band performed alongside Justin Timberlake in the halftime show of Super Bowl LII. The band was featured in Timberlake\u2019s R&B hit \u201cSuit & Tie\u201d, and performed additional choreography and drill during \u201cMirrors\" and the show\u2019s finale, \"Can't Stop the Feeling!\". When it was originally formed, the band consisted of exclusively males. Women were first allowed to perform with the band in 1943-1945, when they were allowed to \"fill in\" for male members of the band that were serving in World War II. In 1950, a \"Women's division\" of the band was created, which lasted for several years. Women were finally allowed to be full members of the band in 1972. Molly Watters was selected in 2006 as the first female Drum Major in the history of the band. In July 2016, Betsy McCann was named the director of the band, becoming the first female director in the history of the band, and of all marching bands in the Big Ten Conference."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[200, 217], [0, 17], [447, 456], [755, 764], [185, 203], [164, 174], [124, 133], [303, 312], [113, 130], [69, 86]], "rd_topk": 4}, "test_2063": {"question": "AVATAR the last Airbender season 3 episode 12", "answer": ["The Western Air Temple"], "prediction": ["Sozin's Comet", "Sozin's Comet", "Sozin's Comet\"", "\"Sozin's Comet", "Gone Gark", "\"Daybreak", "Daybreak", "The Ember Island Players", "Sozin's Comet", "Eight Hours"], "score": [84.22026062011719, 83.40834045410156, 83.15167236328125, 82.85166931152344, 81.90693664550781, 80.75636291503906, 80.25628662109375, 80.20199584960938, 79.77459716796875, 79.42782592773438], "title": [["Avatar: The Last Airbender"], ["Avatar: The Last Airbender"], ["Avatar: The Last Airbender"], ["Avatar: The Last Airbender"], ["List of Counterfeit Cat episodes"], ["Daybreak (Battlestar Galactica)"], ["Music of Battlestar Galactica (2004 TV series)"], ["The Legend of Korra (season 4)"], ["Avatar: The Last Airbender"], ["The Armory (Falling Skies)"]], "evidence": ["Avatar: The Last Airbender (Avatar: The Legend of Aang in some regions) is an American animated television series that aired for three seasons on Nickelodeon. The series began in February 2005 and concluded with a two-hour episode titled Sozin's Comet in July 2008. \"Avatar: The Last Airbender\" is set in an Asiatic-like world in which some people can manipulate the classical elements with psychokinetic variants of the Chinese martial arts known as \"bending\". The series is presented in a style that combines anime with American cartoons and relies on the imagery of East-and-South Asian, Inuit, and New World societies. It follows the protagonist, twelve-year-old Aang and his friends, who must bring peace and unity to the world by ending the Fire Lord's war with three nations.", "The four-part series finale, \"Sozin's Comet\", had the series' highest ratings. Its first airing averaged 5.6 million viewers, 95 percent more than Nickelodeon had in mid-July 2007. During the week of July 14, it was the most-viewed program by the under-14 demographic. The finale's popularity was reflected in online media; \"Rise of the Phoenix King\", a Nick.com online game based on \"Sozin's Comet\", had almost 815,000 game plays in three days. IGN ranked the series 35th on its list of top 100 animated TV shows.", "The four-part series finale, \"Sozin's Comet\", had the series' highest ratings. Its first airing averaged 5.6 million viewers, 95 percent more than Nickelodeon had in mid-July 2007. During the week of July 14, it was the most-viewed program by the under-14 demographic. The finale's popularity was reflected in online media; \"Rise of the Phoenix King\", a Nick.com online game based on \"Sozin's Comet\", had almost 815,000 game plays in three days. IGN ranked the series 35th on its list of top 100 animated TV shows.", "The four-part series finale, \"Sozin's Comet\", had the series' highest ratings. Its first airing averaged 5.6 million viewers, 95 percent more than Nickelodeon had in mid-July 2007. During the week of July 14, it was the most-viewed program by the under-14 demographic. The finale's popularity was reflected in online media; \"Rise of the Phoenix King\", a Nick.com online game based on \"Sozin's Comet\", had almost 815,000 game plays in three days. IGN ranked the series 35th on its list of top 100 animated TV shows.", "The series first aired on Disney XD in the United Kingdom on May 12, 2016 as part of their \"Epic Thursdays\" block of programming. In the United States, the first episode aired on Disney XD as a sneak preview on May 31, 2016 and officially on June 20, 2016. As of July 7, no new episodes are airing in the UK, as the series appears to be on hiatus. In Canada, it began airing on Teletoon on November 1, 2016 and more episodes are remaining airing on Teletoon, But never released in UK or the US as the series sometimes moves to Canada. The episode, \"Merry Christmax/Low Resolutions\", aired in Canada on December 15, 2016 and making it that the British release date is yet to be revealed for the Christmas special and the previous and future episodes. The 2-part season 1 finale, \"Gone Gark\" premiered on Disney XD on January 30, 2017 in the U.S. and premiered in Canada on February 9, 2017 on Teletoon.", "\"Daybreak\" is the three-part series finale of the reimagined science fiction television series \"Battlestar Galactica\", and are the 74th (labeled \"Daybreak, Part 1\" on the DVD) and 75th (labeled \"Daybreak, Parts 2 & 3\" on the DVD) episodes overall. The episodes aired on the U.S. Sci Fi Channel and SPACE in Canada respectively on March 13 and March 20, 2009. The second part (\"Daybreak, Parts 2 & 3\") is double-length. The episodes were written by Ronald D. Moore, and directed by Michael Rymer. The Season 4.5 DVD and Blu-ray releases for Region 1 feature an extended version of the finale, which not only combines all three parts as a single episode, but also integrates it with new scenes not seen in the aired version of either part. The survivor count shown in the title sequence for Part 1 is 39,516. The survivor count shown in the title sequence for Part 2 is 39,406. At the end of Part 2, Admiral Adama announces the survivor population at approximately 38,000.", "The track listing for the fourth season soundtrack was announced by Bear McCreary on his blog on 19 June 2009. The first disc of the two-disc set consists of cues from the main body of season four, excluding \"Razor\" and \"Daybreak\"; the second disc comprises almost the full score of \"Daybreak\", the series finale. Disc 1: Disc 2 (all from \"Daybreak\"): The next soundtrack, consisting entirely of music from \"\" and \"\", neither of which had previously had music featured on a soundtrack, was released on February 23, 2010. The track list is as follows:", "The season is then followed by the graphic novel trilogy \"\", that picks up immediately after the series finale. After Nickelodeon cut the budget for season 4 by about the amount required for one episode, DiMartino and Konietzko decided to include a clip show episode, which reuses previously produced animation, instead of letting many of the creative staff go. Inspired by \"Samurai Champloo\"s clip show episode \"The Disorder Diaries\", they chose to frame a series of edited clips from the previous seasons of \"The Legend of Korra\" with about five minutes of new animation. Aired as episode 8, \"Remembrances\", the clip show was also intended as \"a lighthearted romp\" similar to \"Avatar: The Last Airbender\"s episode \"The Ember Island Players\" before the series enters its d\u00e9nouement.", "The four-part series finale, \"Sozin's Comet\", had the series' highest ratings. Its first airing averaged 5.6 million viewers, 95 percent more than Nickelodeon had in mid-July 2007. During the week of July 14, it was the most-viewed program by the under-14 demographic. The finale's popularity was reflected in online media; \"Rise of the Phoenix King\", a Nick.com online game based on \"Sozin's Comet\", had almost 815,000 game plays in three days. IGN ranked the series 35th on its list of top 100 animated TV shows.", "The next day, Weaver talks to Tom about the events that occurred the previous night. He then hands Pope over to Tom, who puts him in custody. Tom meets up with Matt for a quick game of catch. After, Tom, Hal, Karen, Dai, Anthony and Margaret go in search for Ben at a local hospital. The episode was written by Graham Yost and directed by Greg Beeman. This marks Beeman's first directional episode of the series. He later goes on to direct the third episode in the series, \"Prisoner of War\" and the season finale, \"Eight Hours\"."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[238, 251], [30, 43], [30, 44], [29, 43], [779, 788], [0, 9], [284, 292], [717, 741], [385, 398], [515, 526]], "rd_topk": 5}, "test_2064": {"question": "Who sings Oh what a night late December back in 63", "answer": ["the Four Seasons"], "prediction": ["The Four Seasons", "The Four Seasons", "The", "the Four Seasons", "Four Seasons", "Frankie Valli & the Four Seasons", "The Four Seasons", "The Four Seasons", "the Four Seasons, written by original Four Seasons", "The Five Satins'"], "score": [81.33177947998047, 80.56361389160156, 78.14765930175781, 77.47767639160156, 77.42076110839844, 76.87947082519531, 76.48580932617188, 75.77191925048828, 74.8719482421875, 73.80892181396484], "title": [["List of number-one singles in Australia during the 1970s"], ["What a Night (Kat DeLuna song)"], ["List of number-one singles in Australia during the 1970s"], ["December, 1963 (Oh, What a Night)"], ["December, 1963 (Oh, What a Night)"], ["The Finer Strings"], ["I Don't Feel Like Dancin'"], ["All by Myself"], ["December, 1963 (Oh, What a Night)"], ["Lost in the Fifties Tonight (In the Still of the Night)"]], "evidence": ["Hits by Australasian artists included \"Matter Of Time\" / \"Only One You\" by Sherbet, \"Sparrow Song\" by The Seekers, \"Have You Never been Mellow\" by Olivia Newton-John, and \"High Voltage\" by AC/DC. Other hits Songs peaking at number two included \"Hold Me Close\" by David Essex, \"Slipping Away\" by Max Merritt & The Meteors, \"December, 1963 (Oh, What a Night)\" by The Four Seasons, \"I Hate the Music\" by John Paul Young, and \"Mississippi\" by Pussycat. Other hits (with their peak positions noted) were \"Money Honey\" by Bay City Rollers (3), \"Darktown Strutters' Ball\" by Ted Mulry Gang (3), \"Moviestar\" by Harpo (3), \"Love Really Hurts Without You\" by Billy Ocean (3), \"We Do It\" by R&J Stone (3), \"Devil Woman\" by Cliff Richard (3), \"Tonight's the Night (Gonna Be Alright)\" by Rod Stewart (3), \"Jeans On\" by David Dundas (3), \"Right Back Where We Started From\" by Maxine Nightingale (4), \"Love to Love You Baby\" by Donna Summer (4), \"You Sexy Thing\" by Hot Chocolate (4), \"A Glass Of Champagne\" by Sailor (4), \"City Lights\" by David Essex (4), \"Rock Me\" by ABBA (4), \"Kiss and Say Goodbye\" by The Manhattans (4), \"Disco Duck\" by Rick Dees & His Cast of Idiots (4), \"That's the Way (I Like It)\" by KC & The Sunshine Band (5), \"Save Your Kisses for Me\" by Brotherhood of Man (5), \"I Write the Songs\" by Barry Manilow (5), \"Let Your Love Flow\" by Bellamy Brothers (6), and \"All By Myself\" by Eric Carmen (7).", "\"What A Night\" is a song by American recording artist Kat DeLuna featuring American recording artist Jeremih. It was released on February 26, 2016, and appeared on DeLuna's compilation album \"Loading \" (2016). The song was written by Jeremih, George M. Ladkani, Samuel Jean, Tyrone Edmond, and the duo Da Beat Freakz. The song contains a sample of \"December, 1963 (Oh, What a Night)\" by American pop rock band The Four Seasons. The music video for \"What a Night\" premiered on March 1, 2016, on DeLuna's Vevo channel. It was directed by Haitian-born model Tyrone Edmond.", "Hits by Australasian artists included \"Matter Of Time\" / \"Only One You\" by Sherbet, \"Sparrow Song\" by The Seekers, \"Have You Never been Mellow\" by Olivia Newton-John, and \"High Voltage\" by AC/DC. Other hits Songs peaking at number two included \"Hold Me Close\" by David Essex, \"Slipping Away\" by Max Merritt & The Meteors, \"December, 1963 (Oh, What a Night)\" by The Four Seasons, \"I Hate the Music\" by John Paul Young, and \"Mississippi\" by Pussycat. Other hits (with their peak positions noted) were \"Money Honey\" by Bay City Rollers (3), \"Darktown Strutters' Ball\" by Ted Mulry Gang (3), \"Moviestar\" by Harpo (3), \"Love Really Hurts Without You\" by Billy Ocean (3), \"We Do It\" by R&J Stone (3), \"Devil Woman\" by Cliff Richard (3), \"Tonight's the Night (Gonna Be Alright)\" by Rod Stewart (3), \"Jeans On\" by David Dundas (3), \"Right Back Where We Started From\" by Maxine Nightingale (4), \"Love to Love You Baby\" by Donna Summer (4), \"You Sexy Thing\" by Hot Chocolate (4), \"A Glass Of Champagne\" by Sailor (4), \"City Lights\" by David Essex (4), \"Rock Me\" by ABBA (4), \"Kiss and Say Goodbye\" by The Manhattans (4), \"Disco Duck\" by Rick Dees & His Cast of Idiots (4), \"That's the Way (I Like It)\" by KC & The Sunshine Band (5), \"Save Your Kisses for Me\" by Brotherhood of Man (5), \"I Write the Songs\" by Barry Manilow (5), \"Let Your Love Flow\" by Bellamy Brothers (6), and \"All By Myself\" by Eric Carmen (7).", "\"December, 1963 (Oh, What a Night)\" is a song by the Four Seasons, written by original Four Seasons keyboard player Bob Gaudio and his future wife Judy Parker, produced by Gaudio, and included on the group's album, \"Who Loves You\" (1975). The song features drummer Gerry Polci on lead vocals, with the usual lead Frankie Valli singing the bridge sections and backing vocals, and bass player Don Ciccone (former lead singer of The Critters) singing the falsetto part (\"And I felt a rush like a rolling ball of thunder / Spinning my head around and taking my body under\").", "\"December, 1963 (Oh, What a Night)\" is a song by the Four Seasons, written by original Four Seasons keyboard player Bob Gaudio and his future wife Judy Parker, produced by Gaudio, and included on the group's album, \"Who Loves You\" (1975). The song features drummer Gerry Polci on lead vocals, with the usual lead Frankie Valli singing the bridge sections and backing vocals, and bass player Don Ciccone (former lead singer of The Critters) singing the falsetto part (\"And I felt a rush like a rolling ball of thunder / Spinning my head around and taking my body under\").", "A \"Toy Story\" themed cutaway features Woody walking on Buzz Lightyear in bed with Bo Peep, who quips, \"You've got a friend in me.\" In order to enlist Stewie's help in getting revenge on Carter, Brian tells Stewie that Carter said he wouldn't fit in as a member of One Direction but would possibly be a member of O-Town. In the final scene, during the montage of wedding photos, \"December, 1963 (Oh, What a Night)\" by Frankie Valli & the Four Seasons plays in the background. The episode received an audience of 2.26 million viewers, an increase from the previous episode.", "\"I Don't Feel Like Dancin'\" is a song by American pop band Scissor Sisters. It was released in July 2006 as the first single from their album \"Ta-Dah\". It was written by Jason Sellards, Scott Hoffman and Elton John, the last of whom provides piano for the song, and was the band's first top ten single in many countries. The song scored the band their only number one in the United Kingdom to date and is one of their signature tracks. The song's tempo, arrangement, use of falsetto vocals, and subject matter have been compared by reviewers in \"The Guardian\" and \"The Sun\" to Leo Sayer's 1976 hit \"You Make Me Feel Like Dancing\". The song also features a rhythm piano that makes reference to \"December, 1963 (Oh, What a Night)\" by The Four Seasons.", "\"All by Myself\" is a song by American artist Eric Carmen released in 1975. The verse is based on the second movement (\"Adagio sostenuto\") of Sergei Rachmaninoff's \"Piano Concerto No. 2 in C minor\", Opus 18. The chorus is borrowed from the song \"Let's Pretend\", which Carmen wrote and recorded with the Raspberries in 1972. The power ballad was the first single from Carmen's first solo LP after leaving the power pop group the Raspberries and was released in December 1975, to great acclaim. It reached #2 on the \"Billboard\" Hot 100, both Love Machine by The Miracles and December, 1963 (Oh, What a Night) by The Four Seasons, kept the song from #1. \"All By Myself\" did reach #1 on \"Cash Box\" Top 100 Singles and #3 in Canada. The single sold more than one million copies in the United States and was certified gold by the RIAA in April 1976. \"All By Myself\" was Carmen's first of eight US Top 40 hits. In the UK, however, this was his only Top 40 success, peaking at number 12. In a 2006 poll for UK's Five programme \"Britain's Favourite Break-up Songs\", Eric Carmen's version of this song was voted seventeenth.", "\"December, 1963 (Oh, What a Night)\" is a song by the Four Seasons, written by original Four Seasons keyboard player Bob Gaudio and his future wife Judy Parker, produced by Gaudio, and included on the group's album, \"Who Loves You\" (1975). The song features drummer Gerry Polci on lead vocals, with the usual lead Frankie Valli singing the bridge sections and backing vocals, and bass player Don Ciccone (former lead singer of The Critters) singing the falsetto part (\"And I felt a rush like a rolling ball of thunder / Spinning my head around and taking my body under\").", "\"Lost in the Fifties Tonight (In The Still of the Night)\", a single released by country music singer Ronnie Milsap. It is a medley of \"Lost in the Fifties Tonight\" written by Mike Reid and Troy Seals and a cover of The Five Satins' 1956 hit \"In the Still of the Night\". Released in July 1985, the song was Milsap's 42nd single to be released. At the same time, it was also his 27th number-one hit on the \"Billboard\" Hot Country Singles and Tracks chart. Like many of his other singles, the song also fared well as a crossover hit on the \"Billboard\" Adult Contemporary charts as it entered the top 10, peaking at number eight. This is his last top-10 single to appear on this chart."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[361, 377], [410, 426], [361, 364], [49, 65], [53, 65], [417, 449], [732, 748], [609, 625], [49, 99], [215, 231]], "rd_topk": 6}, "test_2065": {"question": "Who sings the Christmas song Mary did you know", "answer": ["Michael English"], "prediction": ["Michael English", "Christian recording artist Michael English", "Michael", "Mark Lowry", "Cee Lo's", "Clay Aiken", "Band Aid", "Band Aid", "Pentatonix's", "Perry Como"], "score": [90.69971466064453, 88.93451690673828, 88.45603942871094, 85.08464050292969, 82.13842010498047, 81.87821960449219, 80.89555358886719, 78.81045532226562, 78.1209716796875, 77.93916320800781], "title": [["Mary, Did You Know?"], ["Mary, Did You Know?"], ["Mary, Did You Know?"], ["Mary, Did You Know?"], ["Mary, Did You Know?"], ["Mary, Did You Know?"], ["Do They Know It's Christmas?"], ["Christmas music"], ["Mary, Did You Know?"], ["To Know You (Is to Love You)"]], "evidence": ["\"Mary, Did You Know?\" is a Christmas song with lyrics written by Mark Lowry and music written by Buddy Greene. It was originally recorded by Christian recording artist Michael English on his self-titled debut solo album in 1991 (English and Lowry were both members of the Gaither Vocal Band at the time). It reached No. 6 on CCM Magazine's AC Chart. Lowry would record the song several times himself, most notably with the Gaither Vocal Band on their 1998 Christmas album \"Still the Greatest Story Ever Told\".", "\"Mary, Did You Know?\" is a Christmas song with lyrics written by Mark Lowry and music written by Buddy Greene. It was originally recorded by Christian recording artist Michael English on his self-titled debut solo album in 1991 (English and Lowry were both members of the Gaither Vocal Band at the time). It reached No. 6 on CCM Magazine's AC Chart. Lowry would record the song several times himself, most notably with the Gaither Vocal Band on their 1998 Christmas album \"Still the Greatest Story Ever Told\".", "\"Mary, Did You Know?\" is a Christmas song with lyrics written by Mark Lowry and music written by Buddy Greene. It was originally recorded by Christian recording artist Michael English on his self-titled debut solo album in 1991 (English and Lowry were both members of the Gaither Vocal Band at the time). It reached No. 6 on CCM Magazine's AC Chart. Lowry would record the song several times himself, most notably with the Gaither Vocal Band on their 1998 Christmas album \"Still the Greatest Story Ever Told\".", "\"Mary, Did You Know?\" is a Christmas song with lyrics written by Mark Lowry and music written by Buddy Greene. It was originally recorded by Christian recording artist Michael English on his self-titled debut solo album in 1991 (English and Lowry were both members of the Gaither Vocal Band at the time). It reached No. 6 on CCM Magazine's AC Chart. Lowry would record the song several times himself, most notably with the Gaither Vocal Band on their 1998 Christmas album \"Still the Greatest Story Ever Told\".", "Chart positions \"Mary, Did You Know?\" is the eleventh track on Cee Lo's Christmas album \"Cee Lo's Magic Moment\". On December 15, 2012 the song appeared on the US R&B Songs chart at number 22. This version is the slowest of all. It also served as the closing credits song to the 2014 20th Century Fox movie \"Son of God\". Chart positions \"Mary, Did You Know?\" is the sixth track on Pentatonix's second Christmas album, \"That's Christmas to Me\". The song both debuted and peaked at No. 26 on the weekly \"Billboard\" Hot 100 chart for the week ending December 6, 2014.", "The song has since gone on to become a modern Christmas classic, being recorded by many artists over the years across multiple genres. \"Mary, Did You Know?\" is originally in the key of E minor, with a tempo of 53 beats per minute based around a chord progression of Em\u2013D\u2013Am\u2013B7sus4\u2013B7 and is in the meter. A duet version recorded by Wynonna Judd and Kenny Rogers on Rogers' holiday album \"The Gift\" peaked at No. 55 on the \"Billboard\" Hot Country Singles & Tracks chart in 1997. Chart positions \"Mary, Did You Know?\" is Clay Aiken's fifth single for his Christmas album \"Merry Christmas with Love\". Aiken performed the song on \"The Tyra Banks Show\".", "\"Do They Know It's Christmas?\" is a song written in 1984 by Bob Geldof and Midge Ure in reaction to television reports of the 1983\u20131985 famine in Ethiopia. It was first recorded in a single day on 25 November 1984 by Band Aid, a supergroup put together by Geldof and Ure and consisting mainly of the biggest British and Irish musical acts at the time. The single was released in the United Kingdom on 3 December 1984 and aided by considerable publicity it entered the UK Singles Chart at number one and stayed there for five weeks, becoming the Christmas number one of 1984. The record became the fastest selling single in UK chart history, selling a million copies in the first week alone and passing 3 million on the last day of 1984, on the way to displacing Wings's \"Mull of Kintyre\" as the biggest-selling single of all time in the UK. It held this title until 1997 when it was overtaken by Elton John's \"Candle in the Wind 1997\", released in tribute to Diana, Princess of Wales following her death. The original version of \"Do They Know It's Christmas?\" has sold 3.8 million copies in the UK to date.", "\"The above ranking results from an aggregation of performances of all different artist versions of each cited holiday song, across all forms of media, from 1/1/15 through 12/31/15.\" In addition to Bing Crosby, major acts that have popularized and successfully covered a number of the titles in the top 30 most performed Christmas songs in 2015 include: Frank Sinatra, Elvis Presley, Andy Williams, and the Jackson 5. While the ASCAP list is relatively popular in the UK and Ireland, it remains largely overshadowed by a collection of chart hits recorded in a bid to be crowned the UK Christmas number one single during the 1970s and 1980s. Band Aid's 1984 song \"Do They Know It's Christmas?\" is the second best selling single in UK Chart history. The 1987 single \"Fairytale of New York\" by The Pogues, a rock band from London, is regularly voted the British public's favourite ever Christmas song, and it is also the most-played Christmas song of the 21st century in the UK. British glam rock bands had major hit singles with Christmas songs in the 1970s; \"Merry Xmas Everybody\" by Slade, \"I Wish It Could Be Christmas Everyday\" by Wizzard and \"Lonely This Christmas\" by Mud, all of which have remained hugely popular. The top ten most played Christmas songs in the UK based on a 2012 survey conducted by PRS for Music, who collect and pay royalties to its 75,000 song-writing and composing members, are as follows:", "Chart positions \"Mary, Did You Know?\" is the eleventh track on Cee Lo's Christmas album \"Cee Lo's Magic Moment\". On December 15, 2012 the song appeared on the US R&B Songs chart at number 22. This version is the slowest of all. It also served as the closing credits song to the 2014 20th Century Fox movie \"Son of God\". Chart positions \"Mary, Did You Know?\" is the sixth track on Pentatonix's second Christmas album, \"That's Christmas to Me\". The song both debuted and peaked at No. 26 on the weekly \"Billboard\" Hot 100 chart for the week ending December 6, 2014.", "\"To Know You (Is to Love You)\" is a popular song. The music was written by Robert Allen, the lyrics by Allan Roberts. The song was published in 1952. The best-known recording of the song was made by Perry Como. It was first recorded on June 19, 1952, as a duet with Betty Hutton which was never released; Como and The Fontane Sisters with Michell Ayres' and his orchestra redid the song on September 9, 1952. This second recording was released as a 78 rpm single in the United States by RCA Victor Records (catalog number 20-4959, with the flip side My Lady Loves to Dance) and in the United Kingdom by HMV in January 1953 (catalog number B-10400, with the flip side Don't Let the Stars Get In Your Eyes). The US version reached #19 on the Billboard charts. Another recording was made by Como of the song on May 21, 1959. This version was done for the album \"Como Swings.\""], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[168, 183], [141, 183], [168, 175], [65, 75], [63, 71], [519, 529], [217, 225], [640, 648], [380, 392], [199, 209]], "rd_topk": 1}, "test_2066": {"question": "Who sings the song I feel it still", "answer": ["Portugal . The Man .", "Portugal . The Man"], "prediction": ["Portugal. The Man", "The Marvelettes", "American rock band Portugal. The Man", "LeVert.", "Collin Raye", "the Beatles", "Elvis Presley", "CeCe Peniston,", "The Man", "the Backstreet Boys'"], "score": [82.83267211914062, 82.74432373046875, 81.22076416015625, 79.22232055664062, 78.76461791992188, 77.47860717773438, 77.04090881347656, 76.47706604003906, 76.39010620117188, 76.34239959716797], "title": [["Feel It Still"], ["Feel It Still"], ["Feel It Still"], ["I'm Still"], ["I Can Still Feel You"], ["I Feel Fine"], ["I Got a Feelin' in My Body"], ["Still I"], ["Trench (album)"], ["I Still..."]], "evidence": ["\"Feel It Still\" is a song by American rock band Portugal. The Man. The song, which has interpolations from The Marvelettes' 1961 hit \"Please Mr. Postman\", was written by the band along with John Hill and Asa Taccone, with the latter two serving as producers. It serves as the second single and first radio single off their eighth studio album \"Woodstock\". The song reached number one on the US Alternative Songs, Mexican and Russian Tophit airplay chart, and became their first entry on the US \"Billboard\" Hot 100, reaching number four as of October 2017. It was also featured in advertisements for the Apple iPad Pro, Vitamin Water, YouTube TV, Graton Resort & Casino, Haven Holidays and in a BBC TV trailer for Radio 2 and the first and second trailers for the 2018 film \"Peter Rabbit\".", "\"Feel It Still\" is a song by American rock band Portugal. The Man. The song, which has interpolations from The Marvelettes' 1961 hit \"Please Mr. Postman\", was written by the band along with John Hill and Asa Taccone, with the latter two serving as producers. It serves as the second single and first radio single off their eighth studio album \"Woodstock\". The song reached number one on the US Alternative Songs, Mexican and Russian Tophit airplay chart, and became their first entry on the US \"Billboard\" Hot 100, reaching number four as of October 2017. It was also featured in advertisements for the Apple iPad Pro, Vitamin Water, YouTube TV, Graton Resort & Casino, Haven Holidays and in a BBC TV trailer for Radio 2 and the first and second trailers for the 2018 film \"Peter Rabbit\".", "\"Feel It Still\" is a song by American rock band Portugal. The Man. The song, which has interpolations from The Marvelettes' 1961 hit \"Please Mr. Postman\", was written by the band along with John Hill and Asa Taccone, with the latter two serving as producers. It serves as the second single and first radio single off their eighth studio album \"Woodstock\". The song reached number one on the US Alternative Songs, Mexican and Russian Tophit airplay chart, and became their first entry on the US \"Billboard\" Hot 100, reaching number four as of October 2017. It was also featured in advertisements for the Apple iPad Pro, Vitamin Water, YouTube TV, Graton Resort & Casino, Haven Holidays and in a BBC TV trailer for Radio 2 and the first and second trailers for the 2018 film \"Peter Rabbit\".", "\"I'm Still\" is a song performed by American contemporary R&B group LeVert. The song is the opening track from the group's debut album \"I Get Hot\" and was issued as the album's first single. The song was produced by lead singer Gerald Levert, and it peaked at #70 on the \"Billboard\" R&B chart in 1985.", "\"I Can Still Feel You\" is a song written by Kim Tribble and Tammy Hyler, and recorded by American country music singer Collin Raye that reached the top of the \"Billboard\" Hot Country Songs chart. It was released in April 1998 as the first single from his album \"The Walls Came Down\". \"I Can Still Feel You\" is in cut time and the key of E major. Raye's vocals range from E4 to B5. Chuck Taylor, of \"Billboard\" magazine reviewed the song favorably saying it boasts a \"strong lyric, a memorable melody, and an outstanding vocal performance\".", "\"I Feel Fine\" is a song written by John Lennon (credited to Lennon\u2013McCartney) and released in 1964 by the Beatles as the A-side of their eighth British single. The song has one of the first uses of guitar feedback in popular music. Lennon wrote the guitar riff while in the studio recording \"Eight Days a Week\". \"I wrote 'I Feel Fine' around that riff going on in the background\", he recalled. \"I told them I'd write a song specially for the riff. So they said, 'Yes. You go away and do that', knowing that we'd almost finished the album \"Beatles for Sale\". Anyway, going into the studio one morning, I said to Ringo, 'I've written this song but it's lousy'. But we tried it, complete with riff, and it sounded like an A-side, so we decided to release it just like that.\" Both John Lennon and George Harrison said that the riff was influenced by a riff in \"Watch Your Step\", a 1961 release written and performed by Bobby Parker and covered by the Beatles in concerts during 1961 and 1962. Paul McCartney said the drums on \"I Feel Fine\" were inspired by Ray Charles's 1959 single \"What'd I Say\".", "\"I Got a Feelin' in My Body\" is a song by Elvis Presley from his 1974 album \"Good Times\". In 1979, it was released posthumously on the reverse side of the single \"There's a Honky Tonk Angel (Who Will Take Me Back In)\". The single reached number 6 in the \"Billboard\" Country Singles Chart. The song was written by Dennis Linde. Presley recorded it on December 10 during the December 10\u201316, 1973 studio sessions for RCA at the Stax Studios in Memphis, Tennessee. Its first release on record was on the album \"Good Times in 1974. 7\" single", "\"Still I\" is a 2007 song by R&B singer CeCe Peniston, recorded in collaboration with Rodney R.K. Jackson and Felipe \u201cWax\u201d Delgado, who initially found success producing and co-writing the Peniston\u2019s gold-certified album \"Finally\" on A&M Records in 1992. The composition, written by both industry veterans, altogether with Nick \"Cello\" Valentine (with whom they formed a new production crew called SandWorx), was to be released on Heat City Records, a music company that dissolved in 1996, and resurrected in 2006 with the signing of Krieg Nation. After their reunion with Peniston herself, producers intended to record a full length R&B album for her, but the singer didn't decide to proceed with the project, and after working on another three tracks (\"Wonder Woman\", \"Next to Me\" and \"Right Here\") she eventually didn't expect either \"Still I\" to go public. Nevertheless, the record was released in September 2007 as a download single on Adrenaline Music, which included in total four mixes by Sandworx.", "The album, like Twenty One Pilots' previous records, contains many different genres of music, including alternative rock, alternative hip hop, pop rock, electronic rock, reggae, hip hop, electropop, rap rock, and pop, with elements of jazz and R&B. It opens with alternative and hard rock song \"Jumpsuit\", dealing with Tyler Joseph's insecurities. It was described by \"Rolling Stone\" as having \"distorted bass guitar, crisp drumming and dark washes of synth\" with Joseph's vocals building from \"a near-whisper to a full-throated scream, to an atmospheric falsetto.\" The song's outro merges into the next track, \"Levitate\", a minimalist rap track. \"Morph\" explores the themes of life after death and references the leading bishop, Nico. The song has been compared to artists such as Khalid, The Prodigy and DJ Shadow. The following track, \"My Blood\" , is an indie pop song about remaining loyal to a friend. The track has been compared to songs such as Foster the People's \"Pumped Up Kicks\" and Portugal. The Man's \"Feel It Still\" due to the song's chorus featuring a falsetto sung by Joseph. \"Chlorine\" is a song about cleansing your mind from dark thoughts. \"Smithereens\" is a \"cute and playful\" song about Joseph's love for his wife, Jenna, whom he married in 2015.", "\"I Still...\" is a song from the Backstreet Boys' fifth studio album, \"Never Gone\". It was the third and final single from the album internationally, except in the United States. The single debuted at number 1 on the Japan International Singles Chart with 20,182 copies (Japan) sold during first week. The music video depicts the Backstreet Boys in a dark urban setting, with each haunted by memories of the same woman. Each Backstreet Boy is filmed in his own vignette: Richardson is drinking at a bar; Dorough is in a cab; Carter is at a bus station; Littrell is on the road; and McLean is in an alley. The video was directed by Matt McDermitt, whom the Boston Globe reported to be only 19 years old at the time of filming. The music video is noted for its excellent use of slow-motion technique; it was nominated for a TRL Italy video for Best #1 Video. It is also the last music video to feature Kevin Richardson on his first tenure in the band, before leaving in 2006 and coming back in 2012."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[48, 65], [107, 122], [29, 65], [67, 74], [119, 130], [102, 113], [42, 55], [39, 53], [1004, 1011], [28, 48]], "rd_topk": 1}, "test_2067": {"question": "Who produced the movie I can only imagine", "answer": ["Cindy Bond", "Pete Shilaimon", "Raymond Harris", "Kevin Downes", "Joe Knopp", "Daryl Lefever", "Mickey Liddell"], "prediction": ["Pete Kipley,", "the Erwin Brothers", "Bart Millard", "Bart Millard himself.", "Robert Kosberg", "Robert Kosberg and Merv Griffin.", "Lions", "Ron Dante", "Dr. Dre", "Elie Samaha"], "score": [82.133544921875, 81.07818603515625, 78.09983825683594, 75.3004379272461, 71.37423706054688, 70.56692504882812, 70.12518310546875, 69.7741928100586, 69.541259765625, 68.94570922851562], "title": [["I Can Only Imagine (MercyMe song)"], ["I Can Only Imagine (film)"], ["I Can Only Imagine (MercyMe song)"], ["I Can Only Imagine (MercyMe song)"], ["My One and Only (film)"], ["My One and Only (film)"], ["I Can Only Imagine (film)"], ["Anyone Can See"], ["If I Can't"], ["The Immortals (1995 film)"]], "evidence": ["\"I Can Only Imagine\" is a ballad with a length of four minutes and eight seconds. The song is set in the key of E major and has a moderately slow tempo of 80 beats per minute with a vocal range from B\u2013G. The song opens up with only a piano, and builds up to include guitar and drums. Millard is credited with both the lyrics and music to the song. The song was produced by Pete Kipley, who had worked with MercyMe previously as well as with artists including Rebecca St. James, Phil Wickham and Lincoln Brewster.", "I Can Only Imagine is a 2018 American Christian drama film directed by the Erwin Brothers and written by Alex Cramer, Jon Erwin, and Brent McCorkle, based on the story behind the MercyMe song of the same name, the best-selling Christian single of all time. The film stars J. Michael Finley as Bart Millard, the lead singer who wrote the song about his relationship with his father (Dennis Quaid). Madeline Carroll, Priscilla Shirer, Cloris Leachman, Trace Adkins and Brody Rose also star. \"I Can Only Imagine\" was released in the United States on March 16, 2018. It was a massive box office success, grossing $85 million worldwide against a production budget of $7 million, becoming the fourth highest-grossing music biopic of all-time in the United States. Some critics praised it as inspiring and noted it as an improvement compared to other faith-based films, while others called it flat and by-the-numbers. At the 2018 Dove Awards, the film won \"Inspirational Film of the Year\".", "Critical reception for \"I Can Only Imagine\" was positive. Steve Losey of AllMusic commented that \"[the song] is a passionate piano-driven ballad. The song considers what it would be like to be in the presence of God. Delivered with conviction, the song is emotionally compelling\". Jesus Freak Hideout's reviewer Kevin Chamberlin felt \"The lyrics for the song are amazing. If you haven't listened to the lyrics, because you're afraid of hearing pop music, get over it and listen to it.\" Kevin McNeese of NewReleaseTuesday commented that \"The definite highlight on [\"Almost There\"] is the worship/ballad 'I Can Only Imagine'... The song starts out with just piano that instantly invokes chills and builds dynamically into a powerful display of drums and guitar. But what makes the song are the lyrics, penned by Bart Millard himself. The song speaks about that day that we all dream about when we finally meet Jesus... It's a song that can't be listened to with eyes open\".", "Critical reception for \"I Can Only Imagine\" was positive. Steve Losey of AllMusic commented that \"[the song] is a passionate piano-driven ballad. The song considers what it would be like to be in the presence of God. Delivered with conviction, the song is emotionally compelling\". Jesus Freak Hideout's reviewer Kevin Chamberlin felt \"The lyrics for the song are amazing. If you haven't listened to the lyrics, because you're afraid of hearing pop music, get over it and listen to it.\" Kevin McNeese of NewReleaseTuesday commented that \"The definite highlight on [\"Almost There\"] is the worship/ballad 'I Can Only Imagine'... The song starts out with just piano that instantly invokes chills and builds dynamically into a powerful display of drums and guitar. But what makes the song are the lyrics, penned by Bart Millard himself. The song speaks about that day that we all dream about when we finally meet Jesus... It's a song that can't be listened to with eyes open\".", "My One and Only is a 2009 comedy-drama film loosely based on a story about George Hamilton's early life on the road with his mother and brother, featuring anecdotes that Hamilton had told to producer Robert Kosberg and Merv Griffin. Kosberg pitched the idea of this true story to screenwriter Charlie Peters, then Merv Griffin shepherded the project from screenplay to production, until his death in 2007. Merv Griffin's company served as one the film's producers and Robert Kosberg executive produced.", "My One and Only is a 2009 comedy-drama film loosely based on a story about George Hamilton's early life on the road with his mother and brother, featuring anecdotes that Hamilton had told to producer Robert Kosberg and Merv Griffin. Kosberg pitched the idea of this true story to screenwriter Charlie Peters, then Merv Griffin shepherded the project from screenplay to production, until his death in 2007. Merv Griffin's company served as one the film's producers and Robert Kosberg executive produced.", "The film was announced in December 2016. Dennis Quaid joined the cast in January 2017. Broadway actor J. Michael Finley, who sang all the songs in the movie, makes his film debut as Bart Millard. The same month, it was announced that the film was slated for release in the spring of 2018. In August 2017, Lionsgate and Roadside Attractions signed on as distributors for the film for a nationwide release in the United States. \"I Can Only Imagine\" grossed $83.4 million in the United States, and Canada and $1.8 million in other territories, for a worldwide total of $85.2 million, against a production budget of $7 million. It is the fourth-highest grossing music biopic of all-time in the United States, behind \"Bohemian Rhapsody\", \"Straight Outta Compton\" and \"Walk the Line\". It is also the highest-grossing independent film of 2018.", "Anyone Can See is Irene Cara's debut album, released in 1982. This album followed up her successful hit singles \"Out Here on My Own\" and \"Fame\". The album is solid R&B featuring such standout songs as \"Reach Out I'll Be There\", \"Slow Down\" and the power ballad title track among others. Includes the hit, \"Anyone Can See\" which peaked at #42 on the \"Billboard\" Hot 100 chart. It was produced by The Archies' Ron Dante.", "\"If I Can't\" is a song by American hip-hop artist 50 Cent, released as the fourth and final single from his debut album, \"Get Rich or Die Tryin'\" (2003). The song is one of four on the album to be produced by hip-hop producer Dr. Dre, with co-production from frequent collaborator Mike Elizondo. Musically, the song describes how 50 Cent believes that \"if I [he] can't do it [referring to anything], it can't be done\". Upon its release, the song was a reasonable commercial success. However, it did not match the commercial success of the album's three previous singles, only peaking at number 76 on the \"Billboard\" Hot 100 in the United States, where the three previous singles had all peaked within the top three. Nevertheless, it did peak in the upper regions of several national charts - most successfully in the United Kingdom, where it peaked at number ten after being released as a double A-side with the G-Unit single \"Poppin' Them Thangs\".", "The Immortals is a 1995 action thriller film produced by Elie Samaha and directed by Brian Grant. Eric Roberts, Tia Carrere, Joe Pantoliano, Chris Rock, William Forsythe, Clarence Williams III and Tony Curtis feature in this film. A crafty nightclub owner (Jack) brings together a group of small-time hoods and teams them up in unusual pairs (black man and white racist, Ivy Leaguer and simpleton) for a set of multiple heists which turn out to be an elaborate double cross against a notorious gangster (Dominic). During an extended standoff in a nightclub between Jack and his band of thieves and Dominic's henchman, the hoods discover why Jack brought them all together for what amounts to a suicidal mission."], "em_top1": false, "em_top10": false, "f1_top1": 0.5, "f1_top10": 0.5, "se_pos": [[373, 385], [71, 89], [810, 822], [810, 831], [200, 214], [200, 232], [305, 310], [408, 417], [226, 233], [57, 68]], "rd_topk": 1}, "test_2068": {"question": "What kind of dog is Charkie from curious George", "answer": ["black cocker spaniel", "cocker spaniel"], "prediction": ["Cocker Spaniel", "hippopotamus,", "Jack Russell terrier", "Yellow Labrador Retriever", "Yorkshire Terrier", "American lobster", "Scottish Terrier", "a Fox Terrier", "Petit Basset Griffon Vend\u00e9en", "parrot"], "score": [76.32795715332031, 74.87533569335938, 74.24134063720703, 73.98119354248047, 73.94927978515625, 73.14767456054688, 72.96066284179688, 72.82086181640625, 72.27340698242188, 72.20692443847656], "title": [["Cocker Spaniel"], ["Zippy (Rainbow)"], ["Tillamook Cheddar (dog)"], ["Christopher Turk"], ["Morkie"], ["George (lobster)"], ["Barney (dog)"], ["My Dog Skip"], ["Soletrader Peek A Boo"], ["Popovich Comedy Pet Theater"]], "evidence": ["Cocker Spaniels have a sweet disposition and tend to be intelligent, making them a good pet for families in particular. This breed of dog is easy to train but due to their sensitive nature do not tend to respond well to harsh training methods. Training using positive reinforcement and encouragement is the best method for the Cocker Spaniel. Cocker Spaniels can suffer from separation anxiety and best enjoy being in a household environment around people. That said, the Cocker Spaniel was bred as a hunting dog and needs regular exercise outdoors. Up to an hour a day is usually enough. Lady, a female American Cocker Spaniel, is featured in the 1955 Disney film \"Lady and the Tramp\". Similarly, a Cocker Spaniel called Charkie features in the popular children's book and TV series, \"Curious George\". There is also a Cocker Spaniel on the Coppertone sunscreen bottle. Footnotes Bibliography", "Zippy is a fictional character on the British children's television programme \"Rainbow\". Zippy is a brownish-orange puppet with a rugby-ball-shaped oval head, blue eyes and a zip for a mouth, hence his name. His voice was first provided by Peter Hawkins and later by Roy Skelton. Violet Philpott and Ronnie Le Drew operated the character, the latter also providing the voice for the 1994 series and \"Rainbow Days\". It is unclear what kind of creature the character represents; while Bungle is a bear and George a hippopotamus, Zippy bears no obvious resemblance to any real animal. Presenter Geoffrey Hayes has said of him, \"I don't think anyone has a clue what he's meant to be.\"", "Tillamook Cheddar (January 17, 1999 - January 29, 2014; Tillie for short) was a Jack Russell terrier dog from Greenwich, Connecticut, who acquired a reputation as an artist. She had work on display at the National Arts Club, collaborating on pieces that were shown with human artists such as Tom Sachs and Dirk Westphal. A 16-pound (7.25 kg) Jack Russell terrier with a white coat and brown and black markings on her face, she was named for Tillamook Cheddar, a brand of cheese produced in the U.S. state of Oregon. She lived in the Clinton Hill neighborhood of Brooklyn, New York, with her owner, F. Bowman Hastie III, a freelance writer and editor. Hastie, who grew up in Oregon, served as her agent, publicist, and manager.", "In the fourth season, Turk is diagnosed with type two diabetes; he initially jokes about this as a way of coping with his fear about the disease, but learns to take it seriously. In the seventh season, Turk has a testicle removed after his daughter, Izzy, kicks him in the groin, causing testicular torsion. Turk and J.D. are best friends and surrogate brothers. They both attended the College of William and Mary (\"Scrubs\" creator Bill Lawrence's alma mater), where they roomed together. They share a goofy sense of humor; for example, they both enjoy dancing \"the robot\", \"dramatic slow running\", pretending to be \"multi-ethnic Siamese doctor\", and also pretending to be the \"World's Most Giant Doctor.\" He and J.D. own a stuffed Yellow Labrador Retriever named Rowdy which they treat like a live dog. J.D. acts as best man at Turk's wedding, and is Izzy's godfather.", "Morkies are active and playful. They form strong attachments to owners as well as desire a lot of attention from their owners. Morkies are very social and love to be played with. They are excitable, energetic, confident, and loyal. This breed can be very difficult because of their stubbornness, which comes from the Yorkshire Terrier side, but they very quickly get the point of what you want so it is important to begin training early on in its life. Morkies normally get along well with other dogs and non-canine pets that they have been brought up with. Morkies can be destructive if left alone for extended periods, and at such times can be prone to excessive barking. Like many dogs, Morkies are suspicious of strangers or unusual sounds in their environment and are quick to alert owners. Common health problems for the Morkie are mainly seen in the eye, ear, or oral region. More health issues this breed is prone to are collapsed trachea and reverse sneezing. Morkies may suffer from the same ailments which Yorkies or Maltese suffer from, which are: tracheal collapse,cataracts, medial patellar luxation, hydrocephalus, valvular heart disease, kidney failure, and glaucoma.", "George (hatched approximately 1869) is an American lobster owned briefly by the City Crab and Seafood restaurant in New York City. Captured in December 2008, he was released back into the wild in January 2009. George weighed , and has an estimated age of 140 years. George was captured off the coast of Newfoundland in December 2008, and sold to the City Crab and Seafood restaurant in Park Avenue South for $100. He arrived at the restaurant on New Year's Eve. Keith Valenti, the restaurant manager, said that \"We never intended him to be sold, just draw attention to the restaurant, and he did.\" Instead, the lobster had been \"sitting in the restaurant's tank and acting as a sort of mascot\"; Valenti explained that \"we bought a big lobster, started taking pictures with kids and it worked out real well\". George was given his name by a young patron of the restaurant, and was treated as a pet. He lived in the tank for approximately ten days.", "Barney Bush (birth name Bernard Bush; September 30, 2000 \u2013 February 1, 2013) was a Scottish Terrier owned by former U.S. President George W. Bush and former First Lady Laura Bush. Barney had his own official web page which redirected to an extension of the White House website. Barney was born in New Jersey and he was often referred to as the \"First Dog\". Barney's mother, Coors, was owned by former Environmental Protection Agency Director and former New Jersey Governor Christine Todd Whitman. The dog's father is known as Kelly. Miss Beazley, the Bushes' other Scottish terrier, is Barney's niece through his half-brother, Clinton.", "My Dog Skip is a memoir by Willie Morris published by Random House in 1995. \"My Dog Skip\" is the story about nine-year-old Willie Morris growing up in Yazoo City, Mississippi, a tale of a boy and his dog in a small, sleepy Southern town that teaches us about family, friendship, love, devotion, trust and bravery. Willie and Skip's relationship goes beyond that of owner and dog, but is a relationship recognized and celebrated by the entire town. In 2000, the book was made into a film of the same name. Although Skip was a Fox Terrier, a number of Jack Russell terriers were used in filming, two of which were Moose, and Moose's son Enzo who both portrayed Eddie on NBC's sitcom \"Frasier\". The original dog in the book, Skip, was actually a Smooth Haired Fox Terrier, and not a Jack Russell portrayed in the movie.", "Ch. Soletrader Peek A Boo, also known as Jilly, is a Petit Basset Griffon Vend\u00e9en show dog owned by Sara Robertson and Wendy Doherty and handled by Gavin Robertson, who won Best in Show at Crufts in 2013. Jilly's owners plan to retire her following her win. Jilly is owned by Sara Robertson and Wendy Doherty and handled by Gavin Robertson. As of March 2013, she is four years old and lives in Wallingford, Oxfordshire. Jilly's dam was Ch. Soletrader My Aphrodisiac, aka \"Dizzy\", who was the most successful dog of her breed in the UK.", "Animals: Lisa (geese), Jennifer (geese), Gabriella (dog), Robbie (dog), Maia (dog), Taylor (cat), Mia (dog), Giselle (parrot), Mabel (dog), Kevin (dog), Jenna (cat), Lily (cat), Lauren (dog), Sofia (dog), Tessa (dog), Keemia (cat), Olivia (cat), Kurt (goat), Helgo (goat), Mr. Diamond (miniature horse), Evie (dog), Kelsie (cat), Jordan (cat), Emily (dog), Talia (dog), Lola (dog), Harper (cat), Elena (cat), Georgie (dog), Brittany (dog). \"The World Famous Popovich Comedy Pet Theater is a family-oriented blend of the unique comedy and juggling skills of Gregory Popovich along with the extraordinary talents of his co-stars."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[700, 714], [513, 526], [80, 100], [732, 757], [317, 334], [42, 58], [83, 99], [523, 536], [53, 81], [118, 124]], "rd_topk": 1}, "test_2069": {"question": "Who won the most gold metals in Olympics", "answer": ["Michael Phelps", "American swimmer Michael Phelps"], "prediction": ["Michael Phelps", "Michael Phelps", "Michael Phelps", "Michael Phelps", "Michael Phelps", "Marit Bj\u00f8rgen", "Marit Bj\u00f8rgen from Norway", "Gillis Grafstr\u00f6m", "Michael Phelps", "Michael Phelps and Mark Spitz"], "score": [83.12637329101562, 82.74779510498047, 82.35546875, 82.33961486816406, 82.3333740234375, 81.20402526855469, 80.7978744506836, 80.25514221191406, 79.94640350341797, 79.90242004394531], "title": [["List of 2012 Summer Olympics medal winners"], ["List of multiple Olympic medalists"], ["Larisa Latynina"], ["2012 Summer Olympics medal table"], ["United States at the 2008 Summer Olympics"], ["2010 Winter Olympics medal table"], ["2010 Winter Olympics medal table"], ["List of Olympic medalists in figure skating"], ["Jason Kenny"], ["Vitaly Scherbo"]], "evidence": ["The 2012 Summer Olympics, officially known as the Games of the XXX Olympiad, were held in London, United Kingdom, from 25 July 2012 to 12 August 2012. Approximately 10,500 athletes participated in 302 events in 26 sports. Athletes from the United States won the most gold medals, with 46, and the most overall, with 103. Michael Phelps and Missy Franklin won the most gold medals at the games with four each. Phelps also won the greatest number of medals overall winning six in total. Bahrain, Botswana, Cyprus, Gabon, Grenada, Guatemala and Montenegro each won their first Olympic medal ever, with Grenada's being gold.", "This article provides a list of multiple Olympic medalists, i.e. those athletes who have won multiple Olympic medals at either the Summer Olympic Games or the Winter Olympic Games. American swimmer Michael Phelps is the most decorated Olympian, having won a total of 28 medals in both individual and team events (23 gold, 3 silver, and 2 bronze). Phelps has also won more individual events than any other Olympian, with 16 medals (13 gold, 2 silver, and 1 bronze). Norwegian cross-country skier Marit Bj\u00f8rgen is the most decorated Winter Olympian, with a total of 15 medals (8 gold, 4 silver, and 3 bronze).", "Latynina's nine gold medals makes her second on the list of most Olympic gold medalists together with Paavo Nurmi, Mark Spitz, and Carl Lewis, only behind Michael Phelps, who has 23. She held the distinction of having more Olympic medals (either individually or with a team) than anybody, from 1964 until 2012. She is the only woman to have won nine gold medals. She is also the only female athlete who at some point has held the record for most Olympic gold medals. Additionally, within the sport of gymnastics, she is the only woman who has won an all-around medal in more than two Olympiads, the only woman who has won an individual event (floor exercise) in more than two Olympiads, and one of only three women who have won every individual event at either the World Championship or Olympic level. She is one of only two female gymnasts (Simone Biles; 2016) to have won team gold, all-around gold and an event final gold at the same Olympics, having done so twice, in 1956 and four years later, in 1960.", "The 2012 Summer Olympics medal table is a list of National Olympic Committees (NOCs) ranked by the number of gold medals won during the 2012 Summer Olympics in London, the capital of the United Kingdom, from 27 July to 12 August 2012. Approximately 10,800 athletes participated in 302 events in 26 sports. Of the 204 NOCs participating, 85 received at least one medal; 56 won at least one gold medal. Athletes from the United States won the most gold medals, with 46, and the most overall, with 103. Michael Phelps and Missy Franklin won the most gold medals at the games with four each. Phelps also won the greatest number of medals overall winning six in total. Bahrain (a gold medal following medals reallocation), Botswana, Cyprus, Gabon, Grenada (a gold medal), Guatemala, and Montenegro won their first Olympic medals. In prior Olympics, however, Montenegrin athletes have won medals as nationals of Serbia and Montenegro and of Yugoslavia. An athlete from Serbia won the first Olympic gold medal for the country as an independent NOC, however, Serbian athletes have previously won gold medals as nationals of Serbia and Montenegro and of Yugoslavia. Moldova lost all the medals it had won and Cameroon won all its medals due to medals reallocation after retesting of doping samples in 2016.", "The U.S. did not win the most gold medals for the first time in a Summer Games since 1992, with China being the country that won the most golds (48\u201336). The United States never led the medal table during the games. However, the U.S. won its most medals ever (112) in a games not held on home soil, had the highest total medal count, and won more silver and bronze medals than any other participating nation. This games also saw a gold medal record for U.S. swimmer Michael Phelps, who won 8 golds surpassing Mark Spitz's record of 7 golds in a single Olympic event in 1972. Phelps also surpassed Spitz, Larisa Latynina of the USSR, Paavo Nurmi of Finland, and U.S. sprinter Carl Lewis to become the current record holder for the most Olympic gold medals (14).", "Cross-country skier Marit Bj\u00f8rgen from Norway won five medals (three gold, one silver, one bronze), more than any other athlete. Chinese short track speed skater Wang Meng tied Bj\u00f8rgen for the lead in gold medals, with three. The medal table is based on information provided by the International Olympic Committee (IOC) and is consistent with IOC convention in its published medal tables. By default, the table is ordered by the number of gold medals the athletes from a nation have won, where a nation is an entity represented by a National Olympic Committee (NOC). The number of silver medals is taken into consideration next and then the number of bronze medals. If nations are still tied, equal ranking is given and they are listed alphabetically. In the men's individual biathlon competition, two silver medals were awarded for a second-place tie, so no bronze medal was awarded for that event.", "Cross-country skier Marit Bj\u00f8rgen from Norway won five medals (three gold, one silver, one bronze), more than any other athlete. Chinese short track speed skater Wang Meng tied Bj\u00f8rgen for the lead in gold medals, with three. The medal table is based on information provided by the International Olympic Committee (IOC) and is consistent with IOC convention in its published medal tables. By default, the table is ordered by the number of gold medals the athletes from a nation have won, where a nation is an entity represented by a National Olympic Committee (NOC). The number of silver medals is taken into consideration next and then the number of bronze medals. If nations are still tied, equal ranking is given and they are listed alphabetically. In the men's individual biathlon competition, two silver medals were awarded for a second-place tie, so no bronze medal was awarded for that event.", "Men's special figures was only included in one Olympic Games before being discontinued. The sole winner of the event was Russian Nikolai Panin, who gave his country its first ever Olympic gold medal. The team event is the newest Olympic figure skating event, first contested in the 2014 Games. It combines the four Olympic figure skating disciplines (men's singles, ladies' singles, pairs, and ice dance) into a single event; gold is awarded to the team that earns the most placement points. Gillis Grafstr\u00f6m earned the most medals in a single event: four medals, three of which gold, in men's singles. The only other skaters to have earned three golds in a single discipline are Sonja Henie in ladies' singles and Irina Rodnina in pairs.", "Kenny is the joint holder of the highest number of Olympic Golds for a British athlete (6) alongside fellow track cyclist Chris Hoy. Kenny's six Olympic gold medals place him the joint 25th in terms of gold medals won in the modern Summer Olympic games since 1896 with only Michael Phelps (23) and Usain Bolt (8) winning more since the Games of the new millennium in 2000. Kenny was born on 23 March 1988. He has an elder brother, Craig. He was educated at Mount St Joseph School in Farnworth. In the run-up to the London 2012 Olympic Games Kenny visited the school and praised the support he had received from his PE teachers.", "Scherbo was introduced to gymnastics at age 7 by his mother. The coaches at his local club arranged for him to be sent to a state boarding school for young athletes where he continued to make progress as a gymnast. His first international performances were in 1990\u20131991, when he competed for the USSR team at the World Championship and the World Cup. He was the 1991 World All-Around silver medalist behind teammate Grigori Misutin; scored a perfect 10.0 on the vault at the European Championships in 1990; and starred at the Goodwill Games in Seattle. He had occasional bouts of inconsistency and as the 1992 Barcelona Olympics approached, the Unified Team coaches regarded him as less of a medal prospect than his more experienced and reliable teammates. In one of the most dominant performances in history, Scherbo won six out of the possible eight awarded gold medals at the 1992 Summer Olympics in Barcelona. His golds came in the team event, the all around, pommel horse (tie), rings, vault, and parallel bars. Only Michael Phelps and Mark Spitz have ever won more golds in a single Olympic Games, and only Phelps and Eric Heiden have won as many individual gold medals (five) at a single Olympic Games."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[321, 335], [198, 212], [155, 169], [500, 514], [465, 479], [20, 33], [20, 45], [492, 508], [274, 288], [1022, 1051]], "rd_topk": 6}, "test_2070": {"question": "Where does half life 2 episode 2 take place", "answer": ["outside City 17"], "prediction": ["City 17", "Black Mesa Research Facility", "City 17 and surrounding areas", "City 17", "City 17", "Ravenholm", "Ravenholm", "City 17", "Eastern European", "Eastern Europe"], "score": [94.12828063964844, 92.82362365722656, 92.2417221069336, 92.13768005371094, 91.92752075195312, 91.61274719238281, 91.48628234863281, 91.11607360839844, 90.99003601074219, 90.93916320800781], "title": [["Half-Life 2: Episode One"], ["Half-Life 2: Episode One"], ["The Orange Box"], ["The Orange Box"], ["Half-Life 2: Episode Two"], ["Locations of Half-Life"], ["Half-Life 2"], ["Half-Life 2: Episode One"], ["Locations of Half-Life"], ["Locations of Half-Life"]], "evidence": ["The game's events take place immediately after those in \"Half-Life 2\", in and around war-torn City 17. \"Episode One\" follows scientist Gordon Freeman and his companion Alyx Vance in humanity's continuing struggle against the alien civilization known as the Combine. When the story begins, Gordon wakes up outside the enemy's base of operations, the Citadel, after being left unconscious from the concluding events of \"Half-Life 2\". During the course of the game, Gordon travels with Alyx as they attempt to evacuate the city. As the game comes to an end, Gordon and Alyx are caught in a major accident, and their fates are revealed in the sequel, \"\".", "The original \"Half-Life\" takes place at a remote laboratory called the Black Mesa Research Facility. The player takes on the role of Gordon Freeman, a scientist involved in an accident that opens an inter-dimensional portal to the world of Xen and floods the facility with hostile alien creatures. After the player guides him in an attempt to escape the facility and close the portal, the game ends with a mysterious figure who offers Freeman employment. The protagonist is subsequently put into stasis by this mysterious character known as the G-Man.", "\"Half-Life 2\" is a science fiction first-person shooter game and the sequel to \"Half-Life\". While remaining similar in style to the original, \"Half-Life 2\" introduces new concepts to the series such as physics-based puzzles and vehicle sections. The game takes place in the fictional City 17 and surrounding areas as the player takes on the role of scientist Gordon Freeman. Freeman is thrust into a dystopian environment in which the aftermath of the events of \"Half-Life\" have come to bear fully upon human society, and he is forced to fight against increasingly unfavorable odds in order to survive. In his struggle, he is joined by various acquaintances, including former Black Mesa colleagues, oppressed citizens of City 17, and the Vortigaunts, all of whom later prove to be valuable allies. \"Half-Life 2\" received critical acclaim, including 35 Game of the Year awards, when it was originally released for Windows in 2004. , over 6.5 million copies of Half-Life 2 have been sold at retail. Although Steam sales figures are unknown, their rate surpassed retail's in mid-2008 and they are significantly more profitable per-unit.", "\"Half-Life 2\" is a science fiction first-person shooter game and the sequel to \"Half-Life\". While remaining similar in style to the original, \"Half-Life 2\" introduces new concepts to the series such as physics-based puzzles and vehicle sections. The game takes place in the fictional City 17 and surrounding areas as the player takes on the role of scientist Gordon Freeman. Freeman is thrust into a dystopian environment in which the aftermath of the events of \"Half-Life\" have come to bear fully upon human society, and he is forced to fight against increasingly unfavorable odds in order to survive. In his struggle, he is joined by various acquaintances, including former Black Mesa colleagues, oppressed citizens of City 17, and the Vortigaunts, all of whom later prove to be valuable allies. \"Half-Life 2\" received critical acclaim, including 35 Game of the Year awards, when it was originally released for Windows in 2004. , over 6.5 million copies of Half-Life 2 have been sold at retail. Although Steam sales figures are unknown, their rate surpassed retail's in mid-2008 and they are significantly more profitable per-unit.", "The Combine, a multidimensional empire which has enslaved Earth, has used the destruction of their Citadel to open a massive portal. This will allow them to summon reinforcements and destroy the Resistance. In the mountains outside City 17, Resistance fighters Gordon Freeman and Alyx Vance climb from the wreckage of the train they used to escape the city. At an old transmission station, they establish communication with resistance scientists Dr. Kleiner and Eli Vance at the White Forest base. They learn that the Resistance may be able to close the portal using a copy of a Combine transmission Alyx is carrying. At an abandoned mine, Alyx is critically wounded by a Combine Hunter. A vortigaunt leads them to an underground Resistance shelter. Gordon recovers larval extract from a nearby antlion colony, necessary for the vortigaunts to heal Alyx. While the vortigaunts heal her, the mysterious G-Man contacts Gordon and hints at Alyx's importance to his own plans, revealing that he saved her life at the Black Mesa Research Facility despite objections from an unspecified third party. He instructs the unconscious Alyx to tell her father to \"prepare for unforeseen consequences\".", "Ravenholm is an Eastern European mining town depicted in \"Half-Life 2\". The town was a hidden location housing refugees from City 17 until it was discovered and attacked by the Combine, using artillery shells filled with headcrabs. Consequently, the town was massacred and its survivors zombified by the headcrabs. The tunnel from Black Mesa East is blocked to prevent the spread of the headcrabs and zombies. The mines are equally infested, and its structures have been heavily damaged. The town's sole survivor, Father Grigori, hunts the zombie population to put it out of its misery. Working from the church, Grigori has rigged numerous traps (one type involves a blade attached to an engine) and overhead walkways to keep himself safe.", "Gordon is reintroduced to Eli and meets another resistance scientist, Dr. Judith Mossman. Alyx introduces Gordon to her pet robot D0g and gives him a \"gravity gun\", an instrument which can manipulate large objects. Black Mesa East comes under Combine attack, and Eli and Mossman are taken to Nova Prospekt, a Combine prison. Separated from Alyx, Gordon detours through the zombie-infested town of Ravenholm, assisted by its last survivor, Father Grigori. Escaping the town, Gordon discovers a resistance outpost, and uses a customized dune buggy to travel a crumbling coastal road to Nova Prospekt, encountering Combine patrols and helping the resistance fend off raids.", "\"Half-Life 2\" picks up the story, in which the G-Man takes Freeman out of stasis and inserts him on a train en route to City 17 an indeterminate number of years after the events of the first game, with Earth now enslaved by the transhuman forces of the Combine. The player guides Gordon to aid in humanity's struggle against the Combine and its human representative, Dr. Wallace Breen. He oversees the occupation from his base of operations in the Citadel, a monolithic building at the heart of City 17. Fighting alongside Gordon is an underground resistance led by former colleague Dr. Eli Vance, as well other allies including Dr. Vance's daughter Alyx Vance and the enigmatic Vortigaunts, an alien species. \"Half-Life 2\" ends with a climactic battle atop the Citadel that inflicts critical damage to its dark fusion reactor. When it seems as if Alyx and Gordon are to be engulfed by the explosion, the G-Man appears once more. After giving a cryptic speech, he extracts Gordon from danger and places him in stasis once again.", "Ravenholm is an Eastern European mining town depicted in \"Half-Life 2\". The town was a hidden location housing refugees from City 17 until it was discovered and attacked by the Combine, using artillery shells filled with headcrabs. Consequently, the town was massacred and its survivors zombified by the headcrabs. The tunnel from Black Mesa East is blocked to prevent the spread of the headcrabs and zombies. The mines are equally infested, and its structures have been heavily damaged. The town's sole survivor, Father Grigori, hunts the zombie population to put it out of its misery. Working from the church, Grigori has rigged numerous traps (one type involves a blade attached to an engine) and overhead walkways to keep himself safe.", "City 17 is a dystopian metropolitan area in Eastern Europe that forms the primary setting for \"Half-Life 2\" and its first expansion, \"\". The city features a variety of architectural styles, mostly Eastern European architecture dating from pre-World War II neoclassicism, to post-war revival of classical designs, Soviet modernism, and post-Soviet contemporary designs, as well as Combine structures. The playable area of the city is quite large, including a railway station, a dilapidated canal system, underground road tunnels, multiple communal living quarters and crowded, tightly-packed tenement buildings. The whole city seems to be in an advanced state of urban decay, with abandoned structures and graffiti rampant throughout the city. It contains a large number of signs written in Cyrillic. The city is policed by the Combine Civil Protection, who patrol the streets and suppress dissent with extreme brutality, which is seen frequently in \"Half-Life 2\"."], "em_top1": false, "em_top10": false, "f1_top1": 0.8, "f1_top10": 0.8, "se_pos": [[94, 101], [71, 99], [284, 313], [284, 291], [232, 239], [0, 9], [397, 406], [120, 127], [16, 32], [44, 58]], "rd_topk": 4}, "test_2071": {"question": "Where is nuclear energy used most in the world", "answer": ["United States", "France"], "prediction": ["United States", "The United States", "United States", "United", "Russia", "The United States", "France", "France", "United States", "France"], "score": [91.5263442993164, 90.54154205322266, 89.8937759399414, 89.18750762939453, 89.03858947753906, 88.88812255859375, 88.36280822753906, 88.24617004394531, 87.7956771850586, 87.72209167480469], "title": [["Nuclear power"], ["Nuclear power"], ["Nuclear power by country"], ["Nuclear power"], ["Nuclear power in Russia"], ["Nuclear power by country"], ["Nuclear power by country"], ["Nuclear power"], ["Nuclear energy policy"], ["International reactions to the Fukushima Daiichi nuclear disaster"]], "evidence": ["In addition, there were approximately 140 naval vessels using nuclear propulsion in operation, powered by about 180 reactors. Nuclear power's share of global electricity production has fallen from 16.5% in 1997 to about 10% in 2017, in large part because the economics of nuclear power have become more difficult. Regional differences in the use of nuclear power are large. The United States produces the most nuclear energy in the world, with nuclear power providing 19% of the electricity it consumes, while France produces the highest percentage of its electrical energy from nuclear reactors\u201480% as of 2006.", "In addition, there were approximately 140 naval vessels using nuclear propulsion in operation, powered by about 180 reactors. Nuclear power's share of global electricity production has fallen from 16.5% in 1997 to about 10% in 2017, in large part because the economics of nuclear power have become more difficult. Regional differences in the use of nuclear power are large. The United States produces the most nuclear energy in the world, with nuclear power providing 19% of the electricity it consumes, while France produces the highest percentage of its electrical energy from nuclear reactors\u201480% as of 2006.", "Of the 31 countries in which nuclear power plants operate, only France, Slovakia, Ukraine, Belgium, and Hungary use them as the source for a majority of the country's electricity supply. Other countries have significant amounts of nuclear power generation capacity. By far the largest nuclear electricity producers are the United States with 805 647 GWh of nuclear electricity in 2017, followed by France with 381 846 GWh. As of December 2017 448 reactors with a net capacity of 391 721 MWe are operational and 59 reactors with net capacity of 60 460 MWe are under construction, of those 18 reactors with 19 016 MWe in China.", "In addition, there were approximately 140 naval vessels using nuclear propulsion in operation, powered by about 180 reactors. Nuclear power's share of global electricity production has fallen from 16.5% in 1997 to about 10% in 2017, in large part because the economics of nuclear power have become more difficult. Regional differences in the use of nuclear power are large. The United States produces the most nuclear energy in the world, with nuclear power providing 19% of the electricity it consumes, while France produces the highest percentage of its electrical energy from nuclear reactors\u201480% as of 2006.", "Russia is one of the world's largest producers of nuclear energy. In 2018 total electricity generated in nuclear power plants in Russia was 202.87 TWh, 20,8% of all power generation. The installed gross capacity of Russian nuclear reactors is 31,315 MW by December 2018. Russia has made plans to increase the number of reactors in operation from 31 to 59. Old reactors will be maintained and upgraded, including RBMK units similar to the reactors at Chernobyl. The Russian energy strategy of 2003 set a policy priority for reduction in natural gas based power supply, aiming to achieve this through a doubling of nuclear power generation by 2020. In 2006, the Federal Atomic Energy Agency (Rosatom) announced targets for future nuclear power generation; providing 23% of electricity needs by 2020 and 30% by 2030. In 2013 the Russian state allocated 80.6 billion rubles ($2.4 billion) toward the growth of its nuclear industry, especially export projects where Russian companies build, own and operate the power station, such as the Akkuyu Nuclear Power Plant.", "Nuclear power plants currently operate in 31 countries. Most are in Europe, North America, East Asia and South Asia. The United States is the largest producer of nuclear power, while France has the largest share of electricity generated by nuclear power. In 2010, before the Fukushima Daiichi nuclear disaster, it was reported that an average of about 10 nuclear reactors were expected to become operational per year, although according to the World Nuclear Association, of the 17 civilian reactors planned to become operational between 2007 and 2009, only five actually came on stream.", "Of the 31 countries in which nuclear power plants operate, only France, Slovakia, Ukraine, Belgium, and Hungary use them as the source for a majority of the country's electricity supply. Other countries have significant amounts of nuclear power generation capacity. By far the largest nuclear electricity producers are the United States with 805 647 GWh of nuclear electricity in 2017, followed by France with 381 846 GWh. As of December 2017 448 reactors with a net capacity of 391 721 MWe are operational and 59 reactors with net capacity of 60 460 MWe are under construction, of those 18 reactors with 19 016 MWe in China.", "In addition, there were approximately 140 naval vessels using nuclear propulsion in operation, powered by about 180 reactors. Nuclear power's share of global electricity production has fallen from 16.5% in 1997 to about 10% in 2017, in large part because the economics of nuclear power have become more difficult. Regional differences in the use of nuclear power are large. The United States produces the most nuclear energy in the world, with nuclear power providing 19% of the electricity it consumes, while France produces the highest percentage of its electrical energy from nuclear reactors\u201480% as of 2006.", "In 2004, the largest producer of nuclear energy was the United States with 28% of worldwide capacity, followed by France (18%) and Japan (12%). In 2007, 31 countries operated nuclear power plants. In September 2008 the IAEA projected nuclear power to remain at a 12.4% to 14.4% share of the world's electricity production through 2030. In 2013, almost two years after Fukushima, according to the IAEA there are 390 operating nuclear generating units throughout the world, more than 10% less than before Fukushima, and exactly the same as in Chernobyl-year 1986. Asia is expected to be the primary growth market for nuclear energy in the foreseeable future, despite continued uncertainty in the energy outlooks for Japan, South Korea, and others in the region. As of 2014, 63% of all reactors under construction globally are in Asia.", "In the United States, new-reactor construction has also suffered\u2014not because of public opposition but because of economics and tougher, yet-to-be-determined, safety regulations. In 2007, U.S. utilities applied to the Nuclear Regulatory Commission to build 28 nuclear-power plants before 2020; now, if more than three come online before the end of the decade, it will be a major accomplishment. France is, per capita, the world's most nuclear-powered state. Frequently heralded as a nuclear commercial model for the world, today it's locked in a national debate over a partial nuclear phaseout. President Nicolas Sarkozy is still backing nuclear power, but his Socialist opponent, Fran\u00e7ois Hollande, now well ahead in the polls, has proposed cutting nuclear power's electricity contribution by more than a third by 2025."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[378, 391], [374, 391], [323, 336], [378, 384], [0, 6], [117, 134], [64, 70], [510, 516], [56, 69], [394, 400]], "rd_topk": 5}, "test_2072": {"question": "When was the first Super Bowl the Eagles ever won", "answer": ["2017", "1948"], "prediction": ["Super Bowl LII", "1948", "1980", "1980", "1948", "Super Bowl LII", "January 23, 2005", "1960", "1980", "1947"], "score": [86.83357238769531, 84.97381591796875, 84.20185852050781, 83.78327178955078, 83.66458129882812, 83.64258575439453, 83.57174682617188, 83.4299087524414, 83.41743469238281, 83.32670593261719], "title": [["List of Philadelphia Eagles head coaches"], ["History of the Philadelphia Eagles"], ["Super Bowl XXXIV"], ["1982 Philadelphia Eagles season"], ["Sports in Philadelphia"], ["Philadelphia Eagles"], ["History of the Philadelphia Eagles"], ["History of the Philadelphia Eagles"], ["List of Philadelphia Eagles head coaches"], ["List of Philadelphia Eagles players"]], "evidence": ["This is a list of head coaches for the Philadelphia Eagles. The Philadelphia Eagles are a professional American football team based in Philadelphia, Pennsylvania. The Eagles joined the National Football League (NFL) as an expansion team in 1933. Currently members of the Eastern Division of the National Football Conference (NFC), the team has won three NFL titles and made three Super Bowl appearances (1980, 2004, and 2018), with their first Super Bowl victory coming in Super Bowl LII under second-year head coach Doug Pederson. There have been 22 head coaches of the Eagles in the NFL.", "Led by Van Buren and Neale, the Eagles became a serious competitor for the first time. They had their first winning season as a separate team in 1944. After two more second-place finishes (in 1945 and 1946), the Eagles reached the NFL title game for the first time in 1947. Van Buren, end Pete Pihos, and Bosh Pritchard fought valiantly, but the young team fell to the Chicago Cardinals 28-21 at Chicago's Comiskey Park. Undeterred, the young squad rebounded and returned to face the Cardinals once more in the 1948 championship. With home-field advantage (and a blinding snowstorm) on their side, the Eagles won their first NFL Championship 7-0. Due to the severity of the weather, few fans were on hand to witness the joyous occasion. That would not be the case the following season, however, when the Eagles returned to the NFL championship game for the third consecutive year and won in dominating fashion in front of a large crowd in Los Angeles, beating the Los Angeles Rams 14-0.", "The Rams entered 1999 having been among the league's stragglers for a decade. The reasons are many, including, some suggest, mismanagement by executive John Shaw. The franchise moved to a taxpayer-funded stadium in St. Louis, Missouri for the 1995 season, but continued to struggle. In 1997, the team hired Dick Vermeil as their head coach, bringing him back to the NFL after 15 years of retirement. Vermeil had previously turned the Philadelphia Eagles from one of the worst teams in the league into a Super Bowl team in 1980, but his first two seasons in St. Louis were hardly stellar, winning just 5 games in 1997 and 4 in 1998.", "The 1982 Philadelphia Eagles season resulted in a losing season. This season would mark the end of an era under head coach Dick Vermeil. While under Vermeil the Eagles had the most successful period of their existence up to that time, making the playoffs four straight seasons (1978\u20131981) and having a record of 54\u201347 in six seasons with Vermeil (1976\u20131982) while making the Super Bowl in 1980. Vermeil retired due to burnout but would return to coaching in 1997 with the St. Louis Rams and would lead them to a Super Bowl victory in 1999.", "The Philadelphia Eagles, founded in 1933, are members of the East Division of the National Football Conference (NFC) in the National Football League. They have operated continuously since then, with the partial exception of the 1943 season, when the Eagles temporarily merged with the Pittsburgh Steelers to become the Steagles. The Eagles have won three NFL titles (1948, 1949, 1960), four conference championships, and thirteen division championships. They have made three Super Bowl appearances (in 1980, 2004 and 2018), and won in 2018. The franchise frequently finished at the bottom of the standings in the 1930s, but improved in the 1940s, and became the only NFL team to win back to back championships by shutout (in 1948 and 1949). Though the franchise was average for much of the 1950s, the 1960 championship-winning Eagles were the only team to defeat the Vince Lombardi-coached Packers in a playoff game. The Eagles did not experience much success in the 1960s and early 1970s, but the franchise made four straight playoff appearances starting in 1978, including a Super Bowl appearance in 1980. After another down period, the franchise made the playoffs in six of nine seasons between 1988 and 1996. Andy Reid was hired as head coach in 1999, and across fourteen seasons he led the franchise to nine playoff appearances and a run to the 2004 Super Bowl. After Chip Kelly's three-year tenure as head coach, the Eagles hired Doug Pederson, a former offensive coordinator under Reid. The Eagles defeated the New England Patriots in Super Bowl LII. In 1994, defensive end Reggie White, running back Steve Van Buren, and two-way players Chuck Bednarik and Pete Pihos were named to the National Football League 75th Anniversary All-Time Team.", "The Philadelphia Eagles are a professional American football franchise based in Philadelphia, Pennsylvania. The Eagles compete in the National Football League (NFL) as a member club of the league's National Football Conference (NFC) East division. They are Super Bowl champions, having won Super Bowl LII; their first Super Bowl in franchise history, and their fourth NFL title overall, after winning the Championship Game in 1948, 1949, and 1960. The franchise was established in 1933 as a replacement for the bankrupt Frankford Yellow Jackets, when a group led by Bert Bell secured the rights to an NFL franchise in Philadelphia. Bell, Chuck Bednarik, Bob Brown, Brian Dawkins, Reggie White, Steve Van Buren, Tommy McDonald, Greasy Neale, Pete Pihos, Sonny Jurgensen, Terrell Owens, and Norm Van Brocklin have been inducted to the Pro Football Hall of Fame.", "On January 23, 2005, the Eagles reached a fourth consecutive conference championship game (the first time this happened in the salary cap era of the NFL). At long last, the Eagles justified the hopes of their long-suffering fan base, defeating Michael Vick's much-hyped Atlanta Falcons, 27-10, sending them to their first Super Bowl in 24 years. The victory sent the city of Philadelphia into wild celebrations. With two Super Bowl wins under their belt, the defending champion New England Patriots were heavily favored. McNabb had a great game with 357 yards and three touchdowns, but he also threw three interceptions. Terell Owens returned despite his injury, and caught 122 yards on 9 catches. The game was a defensive struggle through the third quarter, but in the fourth, the Patriots took the lead, with the Eagles trailing ten points. The early game struggle left everyone exhausted, and for his best efforts, McNabb scored one touchdown, but could not get the team within field goal range on the final drive. He was picked off in the closing seconds of the game. The final score was 24-21, and the Patriots had won their third Super Bowl in four years.", "With an earned reputation as a fast-living high-flier, Tose infused the organization with some much-needed panache. Initially, however, he ran the team with more enthusiasm than ability, as was exemplified by his choice to replace Kuharich, the hapless Jerry Williams. Tose also selected former Eagles great Pete Retzlaff as General Manager. In 1971, the Eagles moved from Franklin Field to brand-new Veterans Stadium. In its first season, the \u201cVet\u201d was widely acclaimed as a triumph of ultra-modern sports engineering, a consensus that would be short-lived. Equally short-lived was Williams\u2019s tenure as head coach: after a 3-10-1 record in 1970 and three consecutive blowout losses to Cincinnati, Dallas and San Francisco to open the 1971 season, Williams was fired and replaced by assistant Ed Khayat, a defensive lineman on the Eagles' 1960 NFL championship team. Williams and Khayat were hampered by Retzlaff's decision to trade longtime starting quarterback Norm Snead to the Minnesota Vikings in early 1971, leaving the Eagles a choice between journeyman Pete Liske and the raw Rick Arrington.", "This is a list of head coaches for the Philadelphia Eagles. The Philadelphia Eagles are a professional American football team based in Philadelphia, Pennsylvania. The Eagles joined the National Football League (NFL) as an expansion team in 1933. Currently members of the Eastern Division of the National Football Conference (NFC), the team has won three NFL titles and made three Super Bowl appearances (1980, 2004, and 2018), with their first Super Bowl victory coming in Super Bowl LII under second-year head coach Doug Pederson. There have been 22 head coaches of the Eagles in the NFL.", "This is a complete list of American football players who have played for the Philadelphia Eagles of the National Football League (NFL). It includes players that have played at least one game in the NFL regular season. The Philadelphia Eagles franchise was founded in 1933. The Eagles played in four pre-Super Bowl Era NFL Championships (1947, 1948, 1949 and 1960) winning three (1948, 1949 and 1960). They have also played in three Super Bowls (XV, XXXIX and LII), winning Super Bowl LII."], "em_top1": false, "em_top10": true, "f1_top1": 0, "f1_top10": 1.0, "se_pos": [[473, 487], [511, 515], [522, 526], [389, 393], [367, 371], [290, 304], [3, 19], [839, 843], [404, 408], [350, 354]], "rd_topk": 2}, "test_2073": {"question": "What is the name of the chief justice of Ghana", "answer": ["Sophia Akuffo"], "prediction": ["Sophia Akuffo.", "Sophia Akuffo", "Nana Akuffo-Addo", "Anthony Benin", "Georgina Theodora Wood", "Walter Samuel Nkanu Onnoghen", "Sophia Akuffo,", "Nana Akufo-Addo", "Justice Sophia Akuffo", "Sophia Abena Boafoa Akuffo"], "score": [94.04545593261719, 91.23297119140625, 89.31562805175781, 89.01194763183594, 88.94373321533203, 87.97591400146484, 87.24726867675781, 86.74346923828125, 86.456298828125, 85.9762954711914], "title": [["Chief Justice of Ghana"], ["William Atuguba"], ["Georgina Theodora Wood"], ["Anthony Benin"], ["Francis Kpegah"], ["Chief Justice of Nigeria"], ["Women in Ghana"], ["President of Ghana"], ["Georgina Theodora Wood"], ["Sophia Akuffo"]], "evidence": ["The Supreme Court consists of the Chief Justice and at least nine other judges. The Chief Justice is expected to preside at all sittings of the Supreme Court whenever he or she is present. The Chief Justice oversees the administration of the Court of Appeal of which he or she is the most senior member. He or she is also a member and administrator of the High Court and the Regional Tribunals. The Chief Justice is the chairman of the Judicial Council of Ghana. The council is expected to propose judicial reforms to the Ghana government to help improve the level of administration of justice and efficiency in the Judiciary. It is also expected to be a forum to enhance the administration of justice in Ghana. The current Chief Justice is Sophia Akuffo. She succeeded Georgina Wood who was Ghana's first female Chief Justice. Akuffo was sworn in as Chief Justice by President Akufo-Addo on 19 June 2017. Since its inception in 1876, the Supreme Court has had 25 Chief Justices, including 13 in the Gold Coast era. Justice Francis Yaonasu Kpegah, the most senior of the Supreme Court judges acted as Chief Justice between March 2007 and June 2007.", "William Atuguba is a former justice of the Supreme Court of Ghana. Atuguba was first enrolled as a magistrate on 3 October 1974. He has worked as a private lawyer and served as a prosecutor and state attorney before being appointed a Supreme Court Judge by President Rawlings in 1995. He was the acting Chief Justice from May 25, 2016 until June 3, 2016 while Justice Georgina Theodora Woode was outside the country on official duties. He was for a period, the most senior judge in the Supreme Court. He acted as Chief Justice from February 2017 prior to the retirement of Georgina Theodora Wood on 8 June 2017 until 19 June 2017 when Sophia Akuffo was sworn in by President Akufo-Addo as the new Chief Justice. He has been one of the longest serving members of the Supreme Court of Ghana. He was a judge for 44 years and a Supreme Court judge from 1995 to 2018, a total of almost 23 years.", "Wood worked with the Ghana Police Service as a deputy superintendent and public prosecutor for three years. She later joined the Judicial Service as a District Magistrate in 1974. She rose through the Circuit and High Courts to become the presiding judge of the Appeal Court in 1991. She was appointed to the Supreme Court by President John Kufuor on 12 November 2002, an appointment she had earlier declined. She was nominated for the position of Chief Justice of Ghana in May 2007. On 1 June 2007,the Parliament of Ghana approved her nomination as the new Chief Justice of Ghana by consensus. As at June 2007, this made her the first woman in the history of Ghana to head the Judiciary and also made her at the time, the highest ranked female in Ghana's political history; that rank was surpassed by the appointment of Justice Joyce Adeline Bamford-Addo as Speaker of the 5th Parliament of Ghana's 4th Republic in January 2009. Chief Justice Wood assumed office on 15 June 2007. While in office, she swore-in four Presidents: the President John Evans Atta-Mills in January 2009, Vice-President John Dramani Mahama upon the death of Atta-Mills on 24 July 2012, President-Elect John Dramani Mahama, winner of the December 2012 General Elections on 7 January 2013, Nana Akuffo-Addo, winner of the December 2016 elections on 7 January 2017. She retired as Chief Justice in June 2017. She was succeeded by Justice Sophia Akuffo", "Anthony Benin is a Ghanaian judge and is one of the justices of the Supreme Court of Ghana. He was one of two judges sworn into office by the President of Ghana, John Dramani Mahama in the presence of the Chief Justice of Ghana, Georgina Theodora Wood in November 2012. He has presided in cases of the ECOWAS court.", "Francis Yaonasu Kpegah is a retired Ghanaian judge who was on the Supreme Court of Ghana between 1993 and 2008. He was appointed to the Supreme Court on 6 January 1993. He acted as the Chief Justice of Ghana following the death of George Kingsley Acquah on 25 March 2007 until the appointment of Georgina Theodora Wood on 15 June 2007 as the new Chief Justice. In 2013, he caused a lot of excitement in Ghana when he sued Nana Akufo-Addo, the Presidential candidate of the New Patriotic Party (NPP) for impersonation. His suit sought the High Court to declare that Nana Akufo-Addo was never called to the Ghana Bar and that his private law firm was thus also illegal. This upset many in the NPP including the former President John Kufuor. He was also subjected to various attacks through the media to which he responded that he would like Nana Akufo-Addo to go through the court process in answering back.", "The Chief Justice of Nigeria or CJN is the head of the judicial arm of the government of Nigeria, and presides over the country's Supreme Court and the National Judicial Council The current Chief Justice is Walter Samuel Nkanu Onnoghen who was appointed by the President on acting capacity after the retirement of Mahmud Mohammed who attained the prescribed retirement age. The Supreme Court of Nigeria is the highest court in Nigeria aqond its deciposion thumb yet is final. The Chief Justice of Nigeria is nominated by the President of the Federal Republic of Nigeria upon recommendation by the National Judicial Council and is subject to confirmation by the Senate of the Federal Republic of Nigeria. The CJN holds office at the pleasure of the Nigerian constitution and can only be removed from office by death or on attainment of age 70 whichever occurs first or by impeachment by the Senate of the Federal Republic of Nigeria which requires a super majority of the members of the Nigerian Senate Source: Federal Judicial Service Commission, Nigeria", "Multiple forms of violence against women still exist in Ghana. In recent years, feminist organizations and women's rights groups have increased. Efforts to bring about gender equality continue to grow in Ghana. The government of Ghana has signed on to numerous international goals and conventions to enhance women's rights in Ghana. Although women are guaranteed political participation rights under the 1992 Ghana Constitution, there is a lack of female representation in government. There has never been a female president in Ghana. In 2012, 19 women occupied seats in Parliament, while 246 men occupied the rest of the seats. In 2017, the number of women elected to Parliament grew, and 37 women were elected. However, Ghanian women still make up only 13.5% of Parliament. In the courts, the Chief Justice is Sophia Akuffo, the second women to be appointed to this position. The first women to be appointed as Chief Justice was Georgina Wood. Additionally, women only make up a small percentage of the total judges in high and Supreme Courts. In 2009, 23% of Supreme Court judges were women.", "The President of the Republic of Ghana is the elected head of state and head of government of Ghana, as well as Commander-in-Chief of the Ghana Armed Forces. The current President of Ghana is Nana Akufo-Addo, who won the 2016 presidential election against the incumbent, John Dramani Mahama, by a margin of 9.45%. Nana Akufo-Addo was sworn into office on 7 January 2017. According to Chapter 8, Article 62 of the 1992 Constitution of Ghana, a person shall not be qualified for election as the President of Ghana unless:", "Wood worked with the Ghana Police Service as a deputy superintendent and public prosecutor for three years. She later joined the Judicial Service as a District Magistrate in 1974. She rose through the Circuit and High Courts to become the presiding judge of the Appeal Court in 1991. She was appointed to the Supreme Court by President John Kufuor on 12 November 2002, an appointment she had earlier declined. She was nominated for the position of Chief Justice of Ghana in May 2007. On 1 June 2007,the Parliament of Ghana approved her nomination as the new Chief Justice of Ghana by consensus. As at June 2007, this made her the first woman in the history of Ghana to head the Judiciary and also made her at the time, the highest ranked female in Ghana's political history; that rank was surpassed by the appointment of Justice Joyce Adeline Bamford-Addo as Speaker of the 5th Parliament of Ghana's 4th Republic in January 2009. Chief Justice Wood assumed office on 15 June 2007. While in office, she swore-in four Presidents: the President John Evans Atta-Mills in January 2009, Vice-President John Dramani Mahama upon the death of Atta-Mills on 24 July 2012, President-Elect John Dramani Mahama, winner of the December 2012 General Elections on 7 January 2013, Nana Akuffo-Addo, winner of the December 2016 elections on 7 January 2017. She retired as Chief Justice in June 2017. She was succeeded by Justice Sophia Akuffo", "Sophia Abena Boafoa Akuffo (born 20 December 1949) is the Chief Justice of Ghana and has been a Judge of the Supreme Court of Ghana since 1995. Akuffo trained as a lawyer under Nana Akufo-Addo. She has a master's degree in law from Harvard University. Akuffo has been a member of the Governing Committee of the Commonwealth Judicial Education Institute, and the Chairperson of the Alternative Dispute Resolution Task Force. In January 2006 she was elected one of the first judges of the African Court on Human and Peoples' Rights: initially elected for two years, she was subsequently re-elected until 2014 and served as Vice-President and President of the Court."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[741, 755], [635, 648], [1264, 1280], [0, 13], [296, 318], [207, 235], [812, 826], [192, 207], [1403, 1424], [0, 26]], "rd_topk": 3}, "test_2074": {"question": "Where does the highway of heroes start and end", "answer": ["Glen Miller Road in Trenton"], "prediction": ["the Oklahoma state line", "Oklahoma state line", "Longview", "Windthorst", "Carter, Oklahoma", "Folkston", "Newport, Oregon", "Uvalde", "near Covington, Kentucky", "Bishop, California"], "score": [77.13957977294922, 76.15956115722656, 75.6062240600586, 74.60679626464844, 74.35322570800781, 74.28532409667969, 73.94781494140625, 73.71015930175781, 73.31005096435547, 73.2601318359375], "title": [["Arkansas Highway 246"], ["Arkansas Highway 246"], ["Texas State Highway 300"], ["Texas State Highway 25"], ["Oklahoma State Highway 55"], ["Georgia State Route 252"], ["U.S. Route 20 in Ohio"], ["Texas State Highway 55"], ["U.S. Route 25 in Ohio"], ["U.S. Route 6"]], "evidence": ["Highway 246 (AR 246, Ark. 246, and Hwy. 246) is a designation of two state highways in Southwest Arkansas. The route begins at the Oklahoma state line and runs east to US Highway 59 (US 59) and US 71 in Hatfield. A second segment begins at US 59/US 71 near Vandervoort and runs east to AR 84. The highways were created in 1963 and 1957, respectively during a period of highway system expansion. Both routes are maintained by the Arkansas Department of Transportation (ArDOT). AR 246 was designated by the Arkansas State Highway Commission on July 10, 1957, during a period of expansion in the state highway system. The Arkansas General Assembly passed the Act 148 of 1957, the Milum Road Act, creating of new state highways in each county. The first route began at US 71 near Vandevoort and ran east for . The Hatfield segment was created on April 24, 1963. The Vandevoort segment was extended east to the Howard County line in 1965, with a final extension to AR 84 in 1972.", "Highway 246 (AR 246, Ark. 246, and Hwy. 246) is a designation of two state highways in Southwest Arkansas. The route begins at the Oklahoma state line and runs east to US Highway 59 (US 59) and US 71 in Hatfield. A second segment begins at US 59/US 71 near Vandervoort and runs east to AR 84. The highways were created in 1963 and 1957, respectively during a period of highway system expansion. Both routes are maintained by the Arkansas Department of Transportation (ArDOT). AR 246 was designated by the Arkansas State Highway Commission on July 10, 1957, during a period of expansion in the state highway system. The Arkansas General Assembly passed the Act 148 of 1957, the Milum Road Act, creating of new state highways in each county. The first route began at US 71 near Vandevoort and ran east for . The Hatfield segment was created on April 24, 1963. The Vandevoort segment was extended east to the Howard County line in 1965, with a final extension to AR 84 in 1972.", "State Highway 300 or SH 300 is a Texas state highway that runs from Longview northwest to Gilmer. It is also known as Gilmer Road in Gregg County. SH 300 begins at an intersection with U.S. Route 80 on the west side of Longview, and travels northwest through residential sections of the city. The route continues to the northwest, passing through agricultural sections of southeastern Upshur County before reaching its terminus at U.S. Route 271 and State Highway 155 on the far southern edge of Gilmer. The route travels nearly 19 miles. SH 300 was previously designated on January 23, 1939 on a route from Atlanta south to Frazier Creek. On November 20, 1939, SH 300 extended south to SH 49. The route was redesignated on December 16, 1943 as SH 43 when it was extended farther north. The current route was designated on August 2, 1968, replacing FM 1403.", "State Highway 25, or SH 25, is a state highway in north Texas, running from Windthorst north to the Red River near Haynesville. SH 25 was one of the original 25 Texas highway routes proposed on June 21, 1917. The original route was to be from Henrietta to Meridian. On August 21, 1923, all of SH 25 south of Mineral Wells was cancelled. On February 18, 1924, the section from Jacksboro to Henrietta was cancelled, and SH 25 had been rerouted to Archer City. On August 11, 1926, SH 25 extended north to Oklahoma. The route south of Jacksboro became a portion of SH 24 by 1929. On June 24, 1931, the route south of Windthorst became a portion of SH 66, changing it to its current route, with a toll bridge crossing across the Red River into Oklahoma. This crossing is no longer present. SH 25A was a branch designated on April 27, 1925 from Antelope via Henrietta to Oklahoma. On March 19, 1930, the route was renumbered as SH 148.", "State Highway 55 is a state highway in western Oklahoma. It runs for from Carter, Oklahoma to the unincorporated community of Lake Valley. It has no lettered spur routes. SH-55 begins at State Highway 34 in Carter, in eastern Beckham Co.. It heads east for six miles (10 km), where it meets State Highway 6 and overlaps it to the south. After running along the Beckham/Washita Co. line, it splits off to the east near Retrop. It then meets State Highway 44 in Sentinel. Seven miles later it meets US-183 in Rocky. It then terminates at State Highway 54 in Lake Valley.", "State Route 252 (SR 252) is a southwest\u2013northeast state highway located in the southeastern part of the U.S. state of Georgia. It starts in Folkston and winds its way to White Oak. From the route's western terminus at US 1/US 23/US 301/SR 4/SR 15in Folkston, the route runs east-northeast, through rural areas, to its eastern terminus at US 17/SR 25/SR 110 in White Oak.", "U.S. Route 20 (US 20) is a United States Numbered Highway that runs from Newport, Oregon to Boston, Massachusetts. Within the state of Ohio, the route runs from the Indiana border near Edon to the Pennsylvania border at Conneaut. The route passes through rural areas west of Toledo, and passes through Public Square in Cleveland. It is one of 9 other routes to enter downtown Cleveland at Public Square, and it serves some of Cleveland's northeastern suburbs. Prior to the establishment of the U.S. highway system in 1926, the general routing of US 20 was occupied by SR 23 from the Indiana state line to Toledo, SR 102 from Toledo to Woodville, and SR 2 from Woodville east to the Ohio-Pennsylvania border. The route has existed closely to its 1926 routing, except for two bypasses: one built around the north side of Fremont between 1957 and 1958, and a second built around the south side of Norwalk by 1967. By 1932 US 20 between Pioneer and Maumee had become US 20N and a US 20S designation had been created to the south between those points; by 1935 US 20N had reverted to US 20 and US 20S had become US 20A.", "State Highway 55 is a state highway in the U.S. state of Texas. It runs from Uvalde northwestward through the western Hill Country onto the Edwards Plateau, ending south of Sonora. SH 55 was designated from Rocksprings to La Pryor on August 21, 1923, replacing SH 3E and a portion of SH 4. On March 16, 1925, it extended south to SH 2 near Cactus. On October 26, 1926, it was rerouted to Bart. On October 10, 1927, it extended south through Catarina and then east to Artesia Wells. On August 6, 1929 (effective on September 1), SH 55 was truncated to Uvalde, with everything south of there being transferred to SH 4, and the section from Catarina to Artesia Wells was cancelled in exchange for the extension of SH 4. On October 25, 1932, SH 55 extended north to its current terminus.. On November 30, 1932, SH 55 was extended south through Batesville and Dilley to San Diego. On July 15, 1935, SH 55 was shortened to a route from Rocksprings to Uvalde. On November 19, 1935, SH 55 extended back north to SH 30. On January 18, 1937, SH 55 extended to Dilley again. The portion from Uvalde to 4.8 miles southeast of Batesville and from Divot to Dilley were to be constructed starting on March 26, 1942, but upon completion, these sections of SH 55 were to be cancelled and changed to Farm to Market Roads. The section south of Uvalde was cancelled on January 11, 1945, and the portion from Uvalde to 4.8 miles south of Batesville was transferred to FM 117. The section from Dilley to Divot was still under construction, but changed to FM 471 on July 9, 1945.", "US Highway 25 (US 25) was a part of the United States Numbered Highway System in the state of Ohio that ran from its present terminus near Covington, Kentucky, to its Michigan continuation. By the time it was decommissioned in 1973, all but the section north of Cygnet ran concurrently with Interstate 75 (I-75). Before the U.S. Route system was established in 1926, the road that became US 25 was mostly numbered as State Route 6 (SR 6), but was numbered as SR 28 and SR 124 in the Cincinnati area. In 1950s and 1960s, US 25 was transferred to a new freeway that was the basis for I-75. Nearly all of the original road remains intact, however. In 1973, the route was decommissioned, and the independent portion of the highway (north of Cygnet) became the whole of SR 25. In 1987, however, the SR 25 designation on Detroit Avenue was moved to US 24, and SR 25 was moved to the Anthony Wayne Trail, and later, the new Greenbelt Parkway.", "U.S. Route 6 (US 6), also called the Grand Army of the Republic Highway, honoring the American Civil War veterans association, is a main route of the U.S. Highway system. While it currently runs east-northeast from Bishop, California to Provincetown, Massachusetts, the route has been modified several times. The highway's longest-lasting routing, from 1936 to 1964, had its western terminus at Long Beach, California. During this time, US 6 was the longest highway in the country. In 1964, the state of California renumbered its highways, and most of the route within California was transferred to other highways. This dropped the highway's length below that of US 20."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[127, 150], [131, 150], [68, 76], [76, 86], [74, 90], [140, 148], [73, 88], [77, 83], [134, 158], [215, 233]], "rd_topk": 2}, "test_2075": {"question": "Who has won the most Masters green jackets", "answer": ["Jack Nicklaus"], "prediction": ["Jack Nicklaus", "Jack Nicklaus", "Nicklaus", "Jack Nicklaus", "Jack Nicklaus", "Jack Nicklaus", "Jack Nicklaus", "Jack Nicklaus", "Tiger Woods", "Ronnie O'Sullivan"], "score": [76.32917785644531, 76.02999114990234, 73.95263671875, 73.31834411621094, 73.003173828125, 72.93133544921875, 72.42507934570312, 71.89280700683594, 71.70954895019531, 71.57304382324219], "title": [["List of Masters Tournament champions"], ["Masters Tournament"], ["Masters Tournament"], ["1963 Masters Tournament"], ["Masters Tournament"], ["Gary Player"], ["List of men's major championships winning golfers"], ["1966 Masters Tournament"], ["Timeline of golf (2000\u2013present)"], ["Masters (snooker)"]], "evidence": ["Jack Nicklaus holds the record for the most Masters victories, winning the tournament six times during his career. Nicklaus is also the oldest winner of the Masters: he was 46 years 82 days old when he won in 1986. Nicklaus, Nick Faldo, and Tiger Woods co-hold the record for most consecutive victories with two. Woods was the youngest winner of the Masters, 21 years 104 days old when he won in 1997. Woods also set the record for the widest winning margin (12 strokes), and the lowest winning score, with 270, 18 below par (-18) in 1997. The latter was equaled by Jordan Spieth in 2015. The highest winning score of 289 (+1) was originally set by Sam Snead in 1954, it was equalled by Jack Burke Jr. in 1956, and Zach Johnson in 2007. Five golfers have won the Masters wire-to-wire; Craig Wood in 1941, Arnold Palmer in 1960, Nicklaus in 1972, Raymond Floyd in 1976, and Jordan Spieth in 2015. Other players have led wire-to-wire if ties after a round are included, most recently Trevor Immelman in the 2008 Masters Tournament. General Specific", "The first winner of the Masters Tournament was Horton Smith in 1934, and he repeated in 1936. The player with the most Masters victories is Jack Nicklaus, who won six times between 1963 and 1986. Arnold Palmer and Tiger Woods have each won four, and Jimmy Demaret, Gary Player, Sam Snead, Nick Faldo, and Phil Mickelson have three titles to their name. Player was the tournament's first overseas winner with his first victory in 1961. Two-time champions include Byron Nelson, Ben Hogan, Tom Watson, Seve Ballesteros, Bernhard Langer, Ben Crenshaw, Jos\u00e9 Mar\u00eda Olaz\u00e1bal, and Bubba Watson.", "Nicklaus has the most Masters wins, with six between 1963 and 1986. Palmer and Tiger Woods won four each, and five have won three titles at Augusta: Jimmy Demaret, Sam Snead, Gary Player, Nick Faldo, and Phil Mickelson. Player, from South Africa, was the first non-American player to win the tournament, in 1961; the second was Seve Ballesteros of Spain, the champion in 1980 and 1983. The Augusta National course first opened in 1933 and has been modified many times by different architects. Among the changes: greens have been reshaped and, on occasion, entirely re-designed, bunkers have been added, water hazards have been extended, new tee boxes have been built, hundreds of trees have been planted, and several mounds have been installed.", "The 1963 Masters Tournament was the 27th Masters Tournament, held April 4\u20137 at Augusta National Golf Club in Augusta, Georgia. 84 players entered the tournament and 50 made the cut at eight-over-par (152). Jack Nicklaus, 23, won the first of his record six Green Jackets with a three-foot (0.9 m) par putt on the final hole to finish one stroke ahead of runner-up Tony Lema. Nicklaus shot a 66 (\u22126) in the second round, which was key in his victory. It was the second of his record 18 major titles; his third came three months later at the PGA Championship in July.", "In 1952 the Masters began presenting an award, known as the Silver Cup, to the lowest-scoring amateur to make the cut. In 1954 they began presenting an amateur silver medal to the low amateur runner-up. There have been six players to win low amateur and then go on to win the Masters as a professional. These players are Cary Middlecoff, Jack Nicklaus, Ben Crenshaw, Phil Mickelson, Tiger Woods and Sergio Garc\u00eda. Jack Nicklaus has won the most Masters (six) and was old when he won in 1986, making him the oldest winner of the Masters. Nicklaus is the record holder for the most top tens, with 22, and the most cuts made, with 37. The youngest winner of the Masters is Tiger Woods, who was old when he won in 1997. In that year Woods also broke the records for the widest winning margin (12 strokes), and the lowest winning score, with 270 (\u221218). Jordan Spieth tied his score record in 2015.", "Gary Player DMS, OIG (born 1 November 1935) is a South African professional golfer widely considered one of the greatest golfers ever. Over his career, Player accumulated nine major championships on the regular tour and six Champions Tour major championship victories, as well as three Senior British Open Championships on the European Senior Tour. At the age of 29, Player won the 1965 U.S. Open and became the only non-American to win all four majors in a career, known as the career Grand Slam. Player became only the third golfer in history to win the Career Grand Slam, following Ben Hogan and Gene Sarazen, and only Jack Nicklaus and Tiger Woods have performed the feat since. Player has won 165 tournaments on six continents over six decades and was inducted into the World Golf Hall of Fame in 1974.", "Jack Nicklaus has won the most majors, achieving 18 victories during his career. Second on the list is Tiger Woods, who has won 14 majors to date; his most recent major victory was at the 2008 U.S. Open. Walter Hagen is third with 11 majors; he and Nicklaus have both won the most PGA Championships with five. Nicklaus also holds the record for the most victories in the Masters, winning the tournament six times. Additionally, Nicklaus shares the record for the most U.S. Open victories with Willie Anderson, Bobby Jones and Ben Hogan, each winning four times. Harry Vardon holds the record for the most Open Championship victories, winning six times during his career. Nicklaus, Woods, Hogan, Gary Player and Gene Sarazen are the only golfers to have won all four of the majors during their career, thus achieving the so-called \"career slam\". Although the U.S. Amateur and The Amateur Championship were once considered to be majors, they are no longer recognized as such, and victories in these competitions are not included in the list. To date, a total of 221 different men have won majors. Of these, 82 have won at least two. General Specific", "The 1966 Masters Tournament was the 30th Masters Tournament, held April 7\u201311 at Augusta National Golf Club in Augusta, Georgia. Jack Nicklaus, age 26, earned his third Green Jacket in an 18-hole Monday playoff and became the first back-to-back champion at the Masters. He ended regulation at even-par 288, tied with Tommy Jacobs and Gay Brewer. Nicklaus shot a 70 in the extra round on Monday to defeat Jacobs (72) and Brewer (78). Nicklaus' score the previous year in 1965 was significantly lower at 271 (\u221217), a record which stood for 32 years.", "Tiger Woods completes what becomes known as the \"Tiger Slam\", holding off David Duval and Phil Mickelson to win the Masters Championship in April to become the first golfer in history to hold, concurrently, all four professional major championships. For good measure, Woods had won the game's fifth most important event, the Tournament Players' Championship as well, in March. By the end of the year, however, Woods would have relinquished three of his titles, on each occasion to players winning their first major title. At the U.S. Open, South African Retief Goosen finally emerged triumphant from a playoff with Mark Brooks, after three-putting from 12 feet on the 72nd hole the previous day knowing that he had two putts for victory. Playing partner Stewart Cink also missed an 18-inch putt of his own at the last hole that, as events turned out, would have allowed him to join the playoff.", "Ronnie O'Sullivan holds the record for the most Masters titles, having won the tournament seven times. Stephen Hendry has won six titles, Cliff Thorburn, Steve Davis, Mark Selby, and Paul Hunter three, and Alex Higgins, Mark Williams and John Higgins two. In 2016, the Masters trophy was renamed the Paul Hunter Trophy in honour of the three-time champion, who died in 2006, aged 27. The oldest champion in Masters history is Ray Reardon, who won the title in 1976 aged 43 years and 114 days. The youngest champion is O'Sullivan, who won his first title in 1995 aged 19 years and 69 days."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[0, 13], [140, 153], [0, 8], [206, 219], [414, 427], [622, 635], [0, 13], [128, 141], [0, 11], [0, 17]], "rd_topk": 7}, "test_2076": {"question": "What is the latest edition of the intelligent investor", "answer": ["Fourth Revised Edition", "2003"], "prediction": ["Apollo Investment Fund VIII", "TA Tech-Elite Index", "Augmented: Life In The Smart Lane", "10", "Banktivity 6:", "Google Glass Enterprise Edition", "Pyramid 2018", "Augmented Age", "Series B", "Terra Firma Capital Partners IV"], "score": [74.06448364257812, 73.49655151367188, 72.39665222167969, 71.97279357910156, 71.42582702636719, 71.26284790039062, 71.04208374023438, 70.93934631347656, 70.90315246582031, 70.76089477539062], "title": [["Apollo Global Management"], ["TA BlueTech Index"], ["Brett King (businessman)"], ["Nick Sinai"], ["IGG Software"], ["Google Glass"], ["Pyramid Analytics"], ["Brett King (businessman)"], ["Stockspot"], ["Terra Firma Capital Partners"]], "evidence": ["Apollo has historically relied primarily on private equity funds, pools of committed capital from pension funds, insurance companies, endowments, fund of funds, high-net-worth individuals, family offices, sovereign wealth funds and other institutional investors. Since 2014, Apollo has begun investing its eighth private equity fund, Apollo Investment Fund VIII, which raised approximately $18 billion of investor commitments. In 2017, Apollo raised $24.6 billion for its ninth flagship private equity fund, making it the largest in history. Since inception in 1990, Apollo has raised a total of nine private equity funds, including:", "In May 2014, the Tel Aviv Stock Exchange launched a new Index called TA Tech-Elite Index, comprising all the companies listed on either TA-Biomed Index or TA-Technology Index with a market worth of at least 400 million NIS. Also, in order to attract new companies, it was decided that under some circumstances new companies will be allowed to be listed on Tech-Elite Index if their market worth is at least 200 million NIS. In accordance with the launching of Tech-Elite, it was decided that the BlueTech index will include all companies listed on TA-Technology Index and TA-Biomed Index, starting 15 June 2014. Constituents of the TA BlueTech-50 Index as of 1 September 2011", "\"Breaking Banks: The Innovators, Rogues, and Strategists Rebooting Banking?\", (2014) named for his radio show, has the central premise that the banking system is broken, and that banking innovators are fixing the system rather than breaking it down themselves. Jane Haskin of Banking Exchange wrote that \u201cevery banker should read this book\u201d and that \u201cAfter I read one of Brett King\u2019s books, I am always uneasy because it makes me realize how fast banking is changing.\u201d \"Augmented: Life In The Smart Lane\" (2016) is King's latest book. Following on from the Industrial or Machine Age, the Space Age and the Digital Age, the Augmented Age will be based on four key disruptive themes - Artificial Intelligence, Experience Design, Smart Infrastructure, and HealthTech. The book describes how society will be impacted by technologies that will change the world more in the next 20 years than it has in the last 250 years. Augmented topped the Top 10 non-fiction bestsellers in North America. In 2018 it was noted that Chinese President Xi Jinping had \"Augmented\" on his bookshelf.", "Nick is a Senior Advisor and Venture Partner at Insight Venture Partners. Founded in 1995, Insight Venture Partners has raised more than $23 billion and invested in more than 300 growth-stage software, internet, and data companies, including $6.3 billion for its latest fund 10. The firm has over 150 current portfolio companies, has overseen over 225 M&A transactions and has participated in more than 40 IPOs. In the first six months of 2018, three of the top 10 highest valued US venture-backed companies that went public were Insight portfolio companies.", "iBank 4 was updated to be compatible with Mac OS X 10.7. Some iBank 4 features included Direct Connect (downloads from online accounts), iPhone sync, MobileMe compatibility, interactive charts, multiple currencies, a budget monitor, check printing, loan and portfolio management, smart accounts, TurboTax exporting, and Quicken importing. iBank 5 was released November 19, 2013, introducing several new features such as online billpay, Direct Access and Improvements to budgeting. iBank 5 saw the release of six major upgrades to the product through iBank 5.6.4 which included the addition of iBank Cloud Sync. Banktivity 5 released January 28, 2016. After nearly 13 years IGG retired the iBank name, announcing Banktivity as the successor of the IGG\u2019s personal finance software line. Banktivity 6: initial public release on April 25, 2017 List of personal finance software", "In February 2015, \"The New York Times\" reported that Google Glass was being redesigned by former Apple executive Tony Fadell, and that it would not be released until he deemed it to be \"perfect\". In July 2017 it was announced that the second iteration, the Google Glass Enterprise Edition, would be released in the US for companies such as Boeing.. Google Glass Enterprise Edition has already been successfully used by Dr. Ned Sahin to help children with autism learn social skills. Google Glass applications are free applications built by third-party developers. Glass also uses many existing Google applications, such as Google Now, Google Maps, Google+, and Gmail. Many developers and companies have built applications for Glass, including news apps, facial recognition, exercise, photo manipulation, translation, and sharing to social networks, such as Facebook and Twitter. Third-party applications announced at South by Southwest (SXSW) include Evernote, Skitch, \"The New York Times\", and Path.", "On October 20, 2015 Pyramid Analytics secured $30 million for their round B of funding led by Viola Private Equity. In 2016, Pyramid Analytics released BI Office Version 6. In September 2017, Pyramid was featured as a Strong Performer on the \u201cForrester Wave: Enterprise BI Platforms with Majority On-Premises Deployments, Q3 2017\u201d. In October 2017, Pyramid Analytics released Pyramid 2018, the next generation of its BI platform. Pyramid 2018 can run on any HTML5-compliant browser. It includes a new graphically based end-user ETL and supports multiple AI engines and languages (R, Python, TensorFlow, Weka, MLIB, SAS runtime and others).", "\"Breaking Banks: The Innovators, Rogues, and Strategists Rebooting Banking?\", (2014) named for his radio show, has the central premise that the banking system is broken, and that banking innovators are fixing the system rather than breaking it down themselves. Jane Haskin of Banking Exchange wrote that \u201cevery banker should read this book\u201d and that \u201cAfter I read one of Brett King\u2019s books, I am always uneasy because it makes me realize how fast banking is changing.\u201d \"Augmented: Life In The Smart Lane\" (2016) is King's latest book. Following on from the Industrial or Machine Age, the Space Age and the Digital Age, the Augmented Age will be based on four key disruptive themes - Artificial Intelligence, Experience Design, Smart Infrastructure, and HealthTech. The book describes how society will be impacted by technologies that will change the world more in the next 20 years than it has in the last 250 years. Augmented topped the Top 10 non-fiction bestsellers in North America. In 2018 it was noted that Chinese President Xi Jinping had \"Augmented\" on his bookshelf.", "Stockspot was also runner-up in the 2014 Sydstart Startup Pitch Competition and named the top 25 hottest financial services startups from around the globe by Informilo. Stockspot completed a second Series A round of venture capital financing in June 2015 adding Rocket Internet and H2 Ventures onto its register. It was named in the global FinTech100 report by KPMG in December 2015. It completed another round of capital financing (Series B) in May 2017, led by Exchange-traded fund pioneer and ETF Securities founder Graham Tuckwell and Alium Capital.", "Since founding in 1994, Terra Firma has raised five private equity funds. In mid-2011, Terra Firma began speaking with potential investors about the firm's next fund, Terra Firma Capital Partners IV. Terra Firma is targeting to raise upwards of \u00a32.5 billion, which would be roughly half the size of its predecessor with raised \u00a34.8 billion. The following are among the firm's most notable current and former portfolio companies: Terra Firma Capital Partners Limited donates 10% of its annual pre-tax profits each year to charity."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0.28571428571428575, "se_pos": [[334, 361], [69, 88], [470, 503], [275, 277], [785, 798], [257, 288], [376, 388], [623, 636], [433, 441], [167, 198]], "rd_topk": 1}, "test_2077": {"question": "What goes on the bottom of Shepherd's pie", "answer": ["mashed potato", "minced meat"], "prediction": ["a barrel", "the Biblical inscription", "a pomegranate,", "Nativity of Christ", "an apple", "The Celtic cross", "collector's stamp", "tassel", "\"Nativity of Christ", "the name and title of the founder"], "score": [84.21930694580078, 81.93966674804688, 81.14620971679688, 80.76325225830078, 80.61814880371094, 80.59201049804688, 80.43975067138672, 80.38716888427734, 79.9681167602539, 79.29113006591797], "title": [["Adoration of the Shepherds (Raphael)"], ["The Good Shepherd (film)"], ["Angelo De Donatis"], ["Ruthwell Cross"], ["The Allegory of Faith"], ["Church of the Good Shepherd (New York City)"], ["Adoration of the Shepherds (Raphael)"], ["Bell pull"], ["Ruthwell Cross"], ["Canon de 12 de Vallie\u0300re"]], "evidence": ["The theme of the kneeling shepherd with a barrel at his waist also appears in Titian's painting of \"The Holy Family with a Shepherd\", dated to 1510, currently in the National Gallery of London. Titian's kneeling shepherd is on both knees, and supporting himself on one arm. The shepherd's stance is repeated in Murillo's \"Adoration of the Shepherds\", dated to 1665-1670, in the Wallace Collection. Giorgione's dated to 1510, in the National Gallery of Art, includes both the kneeling shepherd and the shepherd stepping into the scene.", "Edward meets with Hayes at the new CIA headquarters still under construction. Edward notes the Biblical inscription on the new marble wall of the CIA lobby: \"And ye shall know the truth, and the truth shall make you free ()\". Hayes tells him that Allen is resigning under a cloud of financial improprieties (after receiving copies of the Swiss accounts delivered in a chocolate box), and that the President has asked him to be the new Director of the CIA. The President has directed him to do some \"housecleaning\" and he tells Edward that he needs someone he can trust, saying, \"after all, we're still brothers\" and that Edward is the \"CIA's heart and soul\". He then tells Edward he will be the first head of counter-intelligence.", "The lion of St. Mark the Evangelist, chosen in honor of the saint to whom is dedicated the parish he led before being appointed a bishop, stands on red, which is the color of love and blood. The umbraculum, the symbol of the Bishop of Rome, over a red background, representing the detachment from earthly values and the ascent of the soul to God. At the bottom is a pomegranate, the symbol of the Passion of Christ, on a background of silver, which symbolizes the purity of the Virgin Mary to whom De Donatis entrusts his episcopal ministry.", "The largest panel on the cross (north side) shows either Christ treading on the beasts, a subject especially popular with the Anglo-Saxons, or its rare pacific variant \"Christ as Judge recognised by the beasts in the desert\", as suggested by the unique Latin inscription surrounding the panel: \"IHS XPS iudex aequitatis; bestiae et dracones cognoverunt in deserto salvatorem mundi\" \u2013 \"Jesus Christ: the judge of righteousness: the beasts and dragons recognised in the desert the saviour of the world.\" Whatever the subject, it is clearly the same as the very similar relief that is the largest panel on the nearby Bewcastle Cross which, subject to dating, was probably created by the same artists. Below this is \"Saints Paul and Antony breaking bread in the desert\", another rare scene identified by an inscription (\"Sanctus Paulus et Antonius duo eremitae fregerunt panem in deserto\"), then either a \"Flight into Egypt\" or perhaps a \"Return from Egypt\", and at the bottom a scene too worn to decipher, which may have been a \"Nativity of Christ\".", "The painting depicts a woman in a fine white and blue satin dress with gold trimmings. She sits on a platform a step higher than the black and white marble floor, her right foot on a terrestrial globe and her right hand on her heart as she looks up, adoringly, at a glass sphere hung from the ceiling by a blue ribbon. Her left arm rests on the edge of a table which holds a golden chalice, a large book, and a dark-wood crucifix. Behind the crucifix is a gilt-leather panel screen. Beneath the book is a long piece of cloth, possibly a priest's stole. Resting on top of the book is a crown of thorns. All of these items are on the platform, which is covered by a green and yellow rug, the edge of which is on the floor. At the bottom of the picture, nearer the viewer, is an apple, and nearer still a snake which has been squashed by a cornerstone. On the dim, far wall behind the woman, a large painting of Christ's crucifixion is hung on the wall behind the woman. To the viewer's left is a multicolored tapestry, pulled back at the bottom and seemingly the closest thing in the painting to the viewer. A chair with a blue cloth on it is immediately beneath and behind the tapestry and to the left of the snake and cornerstone.", "The Church of the Good Shepherd, located at 4967 Broadway at the corner of Isham Street in the Inwood neighborhood of Manhattan, New York City, is a Roman Catholic parish church of the Roman Catholic Archdiocese of New York. It was built in 1935-36 and was designed by Paul Monaghan in the Romanesque Revival style. The Celtic cross at the top of the church is an indication that the parish was originally largely Irish-American; today there are more Dominican-Americans than Irish. The parish was established in 1911 on land purchased by the Paulist Fathers from the Isham Estate. It is currently staffed by the Capuchin Friars. At the time of its founding, Inwood was considered to be \"the unofficial capital of the Irish diaspora\", and the parish was largely made up of Irish-Americans. The parish's first church was built c.1912, to designs by Thomas H. Poole & Company, on a site just down Isham Street from the current church, surrounded by wooded countryside.", "The piece claimed to be Raphael's \"Adoration of the Shepherds\" is by , on paper, executed in red-chalk on an underlying metal point sketch. It has a collector's stamp in the upper right corner, which indicates that it was once part of a collection donated to the library of Urbania, region of Marche, Italy in 1667 by Count Bernardino Ubaldini. The Collezione Ubaldini consisted of a large number of drawings and prints of varying quality. The custodians of the library at the time, the religious order of the Caracciolini, pasted the drawings into two different books; Baldus de Ubaldis' \"Consilia\" from 1490, and Alexander Imolensis' \"Consilia\", Lione edition from 1549. These two volumes are preserved, although the collection has been dismantled. The drawing was not part of Collezione Ubaldini during the great inventory of 1837. If Raphael's \"Adoration of the Shepherds\" drawing had been a part of the collection it is not known when or why it was separated.", "A bell pull is a woven textile, pull cord, handle, knob, or other object that connects with a bell or bell wire, and which rings a bell when pulled. Bell pulls may be used to summon workers in homes of people who employ butlers, housemaids, nannies or other domestic workers, and often have a tassel at the bottom. The bell pull is one element of a complex interior mechanical network which typically in Victorian times involved a range of bell pulls in different rooms; moreover, these bell connections link to a central bank of bells in a room where servants would await commands. In the 19th century some hotels used to have a panel with a bell for each room as a centralized bell system. A bell pull is also used in some forms of public transport, mostly buses to signal to the bus driver to stop the bus.", "The largest panel on the cross (north side) shows either Christ treading on the beasts, a subject especially popular with the Anglo-Saxons, or its rare pacific variant \"Christ as Judge recognised by the beasts in the desert\", as suggested by the unique Latin inscription surrounding the panel: \"IHS XPS iudex aequitatis; bestiae et dracones cognoverunt in deserto salvatorem mundi\" \u2013 \"Jesus Christ: the judge of righteousness: the beasts and dragons recognised in the desert the saviour of the world.\" Whatever the subject, it is clearly the same as the very similar relief that is the largest panel on the nearby Bewcastle Cross which, subject to dating, was probably created by the same artists. Below this is \"Saints Paul and Antony breaking bread in the desert\", another rare scene identified by an inscription (\"Sanctus Paulus et Antonius duo eremitae fregerunt panem in deserto\"), then either a \"Flight into Egypt\" or perhaps a \"Return from Egypt\", and at the bottom a scene too worn to decipher, which may have been a \"Nativity of Christ\".", "The back part consists of, sometimes, an inscription showing the weight of the cannonball (for example a \"12\" for a 12-pounder), followed by a Latin inscription \"\"Nec pluribus impar\"\", meaning that the King is \"Not unequal to many (suns)\". This is followed by the royal crest of the Bourbon dynasty. At the bottom of the gun, the location and date of manufacture are inscribed, and finally the name and title of the founder (in the example \"Fondu par J. Martiz, Commissaire des Fontes\"). The breech is decorated with an animal face showing the rating of the gun (\"Bird\" or \"Rooster\" for a 12-pounder)."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[40, 48], [91, 115], [364, 378], [1026, 1044], [773, 781], [316, 332], [149, 166], [293, 299], [1025, 1044], [390, 423]], "rd_topk": 1}, "test_2078": {"question": "When did the first Junie B Jones book come out", "answer": ["1992"], "prediction": ["1992", "1992", "1992", "1992", "1945", "1983", "1896", "December 1916", "1973", "1991"], "score": [94.80313110351562, 89.09397888183594, 88.8485107421875, 87.99481201171875, 79.69541931152344, 79.36276245117188, 79.20529174804688, 78.82438659667969, 78.76167297363281, 78.24911499023438], "title": [["Junie B. Jones"], ["Bibliography of Barbara Park"], ["Junie B. Jones"], ["Junie B. Jones"], ["Black Boy"], ["The Bumblebee Flies Anyway (novel)"], ["The Jucklins"], ["The Wolf Cub's Handbook"], ["BJU Press"], ["Boy's Life (novel)"]], "evidence": ["Since the original book was published by Random House in 1992, twenty-eight other Junie B. Jones books have been published. Twenty-seven books belong to the Junie B. Jones Series and there is also a \"Junie B. Jones Journal\". The Junie B. Jones series has also been translated into Spanish and French. Juniper Beatrice \"Junie B.\" Jones: The series' title character and main protagonist; a young girl with a friendly, bright, funny, and spirited personality. Junie B. lives with her parents, Robert and Susan, and her baby brother, Ollie. Her birthday is in June, making her either a Gemini or a Cancer in terms of the horoscope. Junie B.'s favorite foods are spaghetti and meatballs, lemon pie, and ice cream.", "Barbara Park, an American author, wrote and published dozens of books for children. Her Junie B. Jones series encompasses 30 books and had collectively sold 55 million copies worldwide as of 2013, according to Park's publisher, Random House. The series started in 1992, with the publication of \"Junie B. Jones and the Stupid Smelly Bus\". \"The New York Times\" described Junie B. Jones, the main character of the series, as \"a 6-year-old dispenser of abundant opinions, Runyonesque wisecracks and dubious syntax.\" When the series began, Junie B. was just entering kindergarten and remained there until \"Junie B., First Grader (at Last!)\", the 18th book in the series, was published in 2001. Park also wrote other books for young readers, including \"Skinnybones\", published in 1982, and \"The Graduation of Jake Moon\", published in 2002. Tie-in products include plush dolls, the \"First Ever Junie B-Shirt\" ().", "Junie B. Jones is a children's book series written by Barbara Park and illustrated by Denise Brunkus. Published by Random House from 1992 to 2013, the stories begin with \"Junie B. Jones and the Stupid Smelly Bus\", in which Junie B. is a fictional \"almost six year old\" starting her first day of kindergarten. Aimed at beginning readers, the series centers on Junie B. Jones, a young girl who is just entering kindergarten in the first book in the series, \"Junie B. Jones and the Stupid Smelly Bus\" (1992). In the opening sentences of that book, she declares, \u201cMy name is Junie B. Jones. The B stands for Beatrice. Except I don\u2019t like Beatrice. I just like B and that\u2019s all.\u201d", "Junie B. Jones is a children's book series written by Barbara Park and illustrated by Denise Brunkus. Published by Random House from 1992 to 2013, the stories begin with \"Junie B. Jones and the Stupid Smelly Bus\", in which Junie B. is a fictional \"almost six year old\" starting her first day of kindergarten. Aimed at beginning readers, the series centers on Junie B. Jones, a young girl who is just entering kindergarten in the first book in the series, \"Junie B. Jones and the Stupid Smelly Bus\" (1992). In the opening sentences of that book, she declares, \u201cMy name is Junie B. Jones. The B stands for Beatrice. Except I don\u2019t like Beatrice. I just like B and that\u2019s all.\u201d", "But in June 1944, the Book of the Month Club expressed an interest in only the Mississippi childhood section, the first fourteen chapters. In response, Wright agreed to eliminate the Chicago section, and in August he renamed the shortened book as \"Black Boy.\" Harper and Brothers published it under that title in 1945; it sold 195,000 retail copies in its first edition and 351,000 copies through the Book-of-the-Month Club. Parts of the Chicago chapters were published during Wright's lifetime as magazine articles, but the six chapters were not published together until 1977, by Harper and Row as \"American Hunger.\" In 1991, the Library of America published all 20 chapters, as Wright had originally intended, under the title \"Black Boy (American Hunger)\" as part of their volume of Wright's \"Later Works\".", "The Bumblebee Flies Anyway is a young adult novel by Robert Cormier. It was published in 1983. This story stars teenaged Barney Snow, an American resident also part of \"the Complex,\" an experimental facility where drugs are tested on children and teens with terminal illnesses. He questions why he is there and what is being done to him but also uncovers a terrible secret about himself. Later, he starts to devise a plan that will take him and the people around him on one last glorious ride. In 1999, a film adaptation was made starring Elijah Wood. It was directed by Martin Duffy.", "The Jucklins is an 1896 novel by Opie Read. It was a best selling book in the United States, (Read asserted that over one million copies were sold) though it never appeared on the best-sellers list in \"The Bookman\" since its early and primary sales were of cheap paperback copies sold on trains and at newsstands. The story is set in the backwoods of North Carolina. Teacher Bill Hawes lives with the Jucklins,a local farming family, including father Lim Jucklin, daughter Guinea and son Alf. Read reported that he sold the book for $700 to publisher Laird & Lee. He needed the cash to pay off a poker debt. A sequel of sorts, \"Old Lim Jucklin\" was released in 1905, and consists of a \"collection of random observations and humors in the cracker-box philosopher manner.\" The novel was also adapted for the stage, and a version adapted by Daniel Hart debuted in Louisville, Kentucky in January 1897, produced by actor Stuart Robson. This version did not get rave reviews, and a wholly rewritten play by playwright Augustus Thomas (also produced by Robson) appeared in December of the same year. A silent film version of the novel directed by George Melford, and starring Winter Hall, Mabel Julienne Scott, and Monte Blue was released in 1921.", "The Wolf Cub's Handbook is an instructional handbook on Wolf Cubs training, published in various editions since December 1916. Early editions were written and illustrated by Robert Baden-Powell with later editions being extensively rewritten by others. The book has a theme based on Rudyard Kipling's \"The Jungle Book\" jungle setting and characters. In 1914, The Boy Scouts Association of the United Kingdom had Percy Everett prepare a program for boys who were too young to be Boy Scouts (at about 11 years old). An outline of his \"Junior Scouts\" program was published in the Headquarters Gazette in 1914. However, Baden-Powell wanted something quite different from a watered down Boy Scout program and recognized that too close an association between the junior program and the Boy Scouts would detract from both. Baden-Powell wanted a junior scheme with distinct name, uniform and other identity and program. In 1916, Baden-Powell published his own outlines for such a scheme, it was to be called Wolf Cubs. Baden-Powell retained elements of Everett's plan but gave it a theme by basing it on Rudyard Kipling's \"Jungle Book\", which had been published a decade earlier and was an established favourite with children. The Wolf Cubs scheme was given a publicity launch at The Boy Scouts Association's Imperial Headquarters in Buckingham Palace Road, Westminster, on Saturday 24 June 1916. Baden-Powell wrote a book for the scheme, \"The Wolf Cub's Handbook\", which was published in December 1916.", "BJU Press founded in 1973, publishes textbooks for Christian schools and homeschools as well as trade and children's books. Although Bob Jones University published its first trade book, \"A History of Fundamentalism in America\" by George W. Dollar in 1973, BJU Press originated in the need for textbooks in the burgeoning Christian school movement. Walter Fremont, Dean of the School of Education, was an \"enthusiastic supporter,\" and much of the early academic direction of the Press was provided by the University's provost, Philip D. Smith. The Press also published the University's magazine, \"Faith for the Family\" from 1973 until publication was discontinued in 1986.", "Boy's Life is a 1991 novel by American writer Robert R. McCammon. It received the World Fantasy Award for Best Novel in 1992.It is considered by readers and critics as his best novel. The story is set in the early 1960s and makes observations about changes in America at that time, with particular emphasis on the Civil Rights Movement. Several of the characters are connected to the Ku Klux Klan, and the segregation of the black community is dealt with in some detail. In the novel, Cory Mackenson shares with the reader his experiences in the fourteenth year of his life. The year begins when his father attempts to rescue a driver as his car plunges into Saxon's Lake, only to discover the man has been beaten to death. Cory spends the rest of the year, despite multiple distractions, attempting to find out who killed this stranger before his father's dreams drive him into the depths of the lake too. Boy's Life is a story of coming of age in the south, an all too real reality mixed with the magic and fantasy of childhood."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[57, 61], [264, 268], [499, 503], [133, 137], [313, 317], [89, 93], [19, 23], [112, 125], [250, 254], [16, 20]], "rd_topk": 4}, "test_2079": {"question": "Who is the actor that plays Dr. Sean Murphy", "answer": ["Freddie Highmore"], "prediction": ["Robert Sean Leonard", "Kevin Carroll", "Robert Clohessy", "Eric Millegan", "Robert Lawrence Leonard", "Glenn Martin Christopher Francis Quinn", "John Connors", "Nicholas Edward Gonzalez", "Thomas Joseph \"T.J.\" Thyne", "Nik Dodani"], "score": [86.18394470214844, 85.57384490966797, 84.97285461425781, 84.86196899414062, 84.75115203857422, 84.70335388183594, 84.4966049194336, 84.49458312988281, 84.4013671875, 84.3618392944336], "title": [["Robert Sean Leonard"], ["Kevin Carroll (actor)"], ["Robert Clohessy"], ["Eric Millegan"], ["Robert Sean Leonard"], ["Glenn Quinn"], ["John Connors (actor)"], ["Nicholas Gonzalez"], ["T. J. Thyne"], ["Nik Dodani"]], "evidence": ["Robert Lawrence Leonard (born February 28, 1969), better known by his stage name Robert Sean Leonard, is an American actor. He is known for playing Dr. James Wilson in the television series \"House\" (2004\u20132012) and Neil Perry in the film \"Dead Poets Society\". Leonard won a Tony Award for Best Featured Actor in a Play for his performance in \"The Invention of Love\" in 2001. His other Broadway credits include \"Candida\", \"Long Day's Journey Into Night\", \"Breaking the Code\", \"The Speed of Darkness\", \"Philadelphia, Here I Come!\", \"Arcadia\", \"The Music Man\", \"Born Yesterday\", and \"To Kill a Mockingbird\".", "Kevin Carroll is an American actor, best known for his role as John Murphy in the HBO television series \"The Leftovers\". Most recently he appeared as Alton Saint on the FX series \"Snowfall\" and as the \"Sinnerman\", the main antagonist in season 3 of the FOX series \"Lucifer\". In 2018 he appeared in the Facebook Watch series \"Sacred Lies\" and in the feature film \"Blindspotting\".", "Robert Clohessy (born June 10, 1957) is an American actor. He is best known for playing Correctional Officer Sean Murphy on the HBO prison drama \"Oz\" from seasons 3-6, in addition to playing Warden Boss James Neary on the HBO crime drama \"Boardwalk Empire\" for the first two seasons and Lieutenant Sid Gormley on police drama \"Blue Bloods\". Clohessy was born in the Bronx, New York, the son of John Clohessy, a police officer. He graduated from SUNY Purchase. He fought in the 1975 Golden Gloves in Madison Square Garden. He graduated from Pearl River High School in Pearl River, New York, and from SUNY Purchase.", "Eric Millegan (born August 25, 1974) is an American actor, best known for his role as Dr. Zack Addy on the Fox series \"Bones\". Millegan was born in Hackettstown, New Jersey, and raised in Springfield, Oregon. Eric attended high school at Springfield High School, where he was student body Vice President his senior year. He studied acting at the Interlochen Arts Camp at Interlochen Center for the Arts before studying musical theatre at the University of Michigan and receiving a Bachelor of Fine Arts degree. Millegan is openly gay. \"Out\" magazine named him the \"Hottest Up-and-Coming Openly Gay Actor of 2003.\". In March 2010, Millegan came out as having bipolar disorder in The Huffington Post. Millegan married his long-time partner, Charles Michel, in New York City on June 28, 2012. He announced his union on Twitter. On November 1, 2015, Millegan ran in the TCS New York City Marathon.", "Robert Lawrence Leonard (born February 28, 1969), better known by his stage name Robert Sean Leonard, is an American actor. He is known for playing Dr. James Wilson in the television series \"House\" (2004\u20132012) and Neil Perry in the film \"Dead Poets Society\". Leonard won a Tony Award for Best Featured Actor in a Play for his performance in \"The Invention of Love\" in 2001. His other Broadway credits include \"Candida\", \"Long Day's Journey Into Night\", \"Breaking the Code\", \"The Speed of Darkness\", \"Philadelphia, Here I Come!\", \"Arcadia\", \"The Music Man\", \"Born Yesterday\", and \"To Kill a Mockingbird\".", "Glenn Martin Christopher Francis Quinn (May 28, 1970 \u2013 December 3, 2002) was an Irish actor. While he was best known for his portrayal of Mark Healy on the popular '90s family sitcom \"Roseanne\", Quinn also amassed a large fan base for his portrayal of Doyle, a half-demon, on \"Angel\", a spin-off series of \"Buffy the Vampire Slayer\". Quinn was born in Dublin, Ireland on May 28, 1970, the son of Murty Quinn, a musician and singer with the Miami Showband who enjoyed seven #1 hits in the '60s and '70s, and his wife, Bernadette Quinn (nee Brady). He was raised in Cabinteely, a suburb of Dublin, and attended Clonkeen College. He emigrated from Ireland to the United States with his mother and two sisters, Sonja and Louisa, in 1988, when he was still just a teenager, with the family settling in Los Angeles, California. Quinn had a third sibling, a brother Ciaran, whom he never knew existed as the boy had been placed for adoption.", "John Connors (born 1990) is an Irish actor, screenwriter, documentary filmmaker and human rights activist best known for his role as Patrick Ward in the Irish crime drama series \"Love/Hate\" and for \" Cardboard Gangsters\" in which he won best actor at the 2017 Irish film and television awards. Connors was born in 1990 in Kings Cross, London, United Kingdom to an Irish traveller family, but moved to Ireland with his family when he was 11 months old. His father suffered from depression and schizophrenia, and took his own life when Connors was eight years old. John took up acting when he was 20 years old after being persuaded by his younger brother Joseph in a bid to help him with his own battle with depression. John began boxing at a young age because he was experiencing bullying. He is a former three-time Irish boxing champion and a four nations boxing gold medalist.", "Nicholas Edward Gonzalez (born January 3, 1976) is an American actor, best known for playing Alex Santiago in the television series \"Resurrection Blvd.\" He currently portrays Dr. Neil Melendez on ABC's \"The Good Doctor\". Gonzalez was born in San Antonio, Texas, where he was a student at Central Catholic High School. He became an accomplished cross-country and track runner, winning the Texas State Championship in the mile and two mile. After graduating in 1994 and turning down a presidential appointment to West Point, Nicholas pursued an English degree at Stanford University in California.", "Thomas Joseph \"T.J.\" Thyne (born March 7, 1975) is an American actor, best known for his role in \"Bones\" as Dr. Jack Hodgins, an entomologist, mineralogist, and botanist. Thyne attended East Ridge Middle School in Ridgefield, Connecticut, before moving south to attend high school in Plano, Texas. He went on to attend the USC School of Dramatic Arts, graduating in 1997. In 2001, he co-founded Theatre Junkies, a group offering workshops and professional development for actors in the Greater Los Angeles Area.", "Nik Dodani (born December 19, 1994) is an American actor and comedian based in Los Angeles. Dodani is best known for his role as Zahid in \"Atypical\", a Netflix original comedy series created by Robia Rashid. Dodani currently stars as Pat Patel in the revival of popular CBS sitcom \"Murphy Brown\", which premiered on September 27, 2018. In addition to Netflix's \"Atypical,\" Dodani is known for his appearances in Comedy Central\u2019s \"Idiotsitter\", Freeform\u2019s \"Kevin From Work\", and NBC\u2019s \"The Player\". He has appeared in the Ben Stiller-produced Netflix film, \"Alex Strangelove\"; in the Sony Pictures thriller, \"The Maze\"\";\" as well as in Joshua Leonard\u2019s upcoming independent film, \"Behold My Heart\", opposite Marisa Tomei and Charlie Plummer. Dodani also performs stand-up and made his late-night comedy debut on The Late Show with Stephen Colbert on September 28, 2018."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[81, 100], [0, 13], [0, 15], [0, 13], [0, 23], [0, 38], [0, 12], [0, 24], [0, 26], [0, 10]], "rd_topk": 1}, "test_2080": {"question": "When does season 13 of America's got talent premiere", "answer": ["May 29 , 2018"], "prediction": ["May 29, 2018", "on May 29, 2018", "May 29, 2018,", "May 30, 2017", "May 31, 2018", "January 15, 2014", "May 31, 2016", "September 25, 2017", "June 17, 2008", "May 30, 2017"], "score": [81.63578033447266, 78.39034271240234, 75.8751220703125, 73.31535339355469, 73.27547454833984, 71.16627502441406, 69.74276733398438, 69.60093688964844, 68.98486328125, 68.53246307373047], "title": [["America's Got Talent (season 13)"], ["America's Got Talent (season 13)"], ["America's Got Talent (season 13)"], ["America's Got Talent (season 12)"], ["America's Got Talent (season 13)"], ["American Idol (season 13)"], ["America's Got Talent (season 11)"], ["The Voice (U.S. TV series)"], ["America's Got Talent (season 3)"], ["America's Got Talent"]], "evidence": ["Season thirteen of the reality competition series \"America's Got Talent\" premiered on May 29, 2018, on NBC. Howie Mandel, Mel B, Heidi Klum and Simon Cowell returned as judges for their respective ninth, sixth, sixth, and third seasons. Meanwhile, Tyra Banks returned for her second season as host. The live shows returned to the Dolby Theatre, beginning August 14, 2018. \"AGT\" is co-produced by FremantleMedia North America and Syco Entertainment, Cowell's company. Dunkin Donuts is a sponsor for a fourth consecutive season.", "Season thirteen of the reality competition series \"America's Got Talent\" premiered on May 29, 2018, on NBC. Howie Mandel, Mel B, Heidi Klum and Simon Cowell returned as judges for their respective ninth, sixth, sixth, and third seasons. Meanwhile, Tyra Banks returned for her second season as host. The live shows returned to the Dolby Theatre, beginning August 14, 2018. \"AGT\" is co-produced by FremantleMedia North America and Syco Entertainment, Cowell's company. Dunkin Donuts is a sponsor for a fourth consecutive season.", "Season thirteen of the reality competition series \"America's Got Talent\" premiered on May 29, 2018, on NBC. Howie Mandel, Mel B, Heidi Klum and Simon Cowell returned as judges for their respective ninth, sixth, sixth, and third seasons. Meanwhile, Tyra Banks returned for her second season as host. The live shows returned to the Dolby Theatre, beginning August 14, 2018. \"AGT\" is co-produced by FremantleMedia North America and Syco Entertainment, Cowell's company. Dunkin Donuts is a sponsor for a fourth consecutive season.", "Season twelve of the reality competition series \"America's Got Talent\" was ordered on August 2, 2016 and premiered on NBC on Tuesday, May 30, 2017. Howie Mandel, Mel B, Heidi Klum and Simon Cowell returned as judges for their respective eighth, fifth, fifth and second seasons. Supermodel and businesswoman Tyra Banks replaced Nick Cannon, who hosted for eight seasons, making her the first female host of the show and the second female to host a \"Got Talent\" show. The live shows returned to the Dolby Theatre in Los Angeles beginning August 15, 2017.", "Guest performers in the finale included Kiss, Bebe Rexha, The Struts, Pl\u00e1cido Domingo, and Lindsey Stirling. Other celebrity appearances included David Spade, Matt Iseman and Akbar Gbaja-Biamila. The following chart describes the acts, appearances and segments presented during the finale. This season is being aired in Asia within 48 hours of being broadcast in the US. It airs on AXN starting May 31, 2018 (). In the United Kingdom and Ireland the first episode was brought to Netflix on May 31. In Singapore, the show was broadcast on MediaCorp Channel 5 every Thursday starting May 31, 2018.", "The thirteenth season of \"American Idol\", styled as American Idol XIII, premiered on the Fox television network on January 15, 2014. Ryan Seacrest returned as host for his thirteenth season. Keith Urban was the only judge from the twelfth season to return. Former judge Jennifer Lopez, who returned after one season absence, and Harry Connick, Jr. joined the judging panel following the departures of Mariah Carey, Nicki Minaj and Randy Jackson, though Jackson returned as a mentor, replacing Jimmy Iovine.", "Season eleven of the reality competition series \"America's Got Talent\" was ordered on September 1, 2015. The season premiered on NBC on Tuesday, May 31, 2016. Nick Cannon returned for his eighth and final season as host. Howie Mandel returned for his seventh season as a judge, while Mel B and Heidi Klum returned for their fourth season. Simon Cowell replaced Howard Stern as the fourth judge. The live shows began on July 26, at the Dolby Theatre in Los Angeles instead of Radio City Music Hall in New York from previous years. Due to the 2016 Summer Olympics broadcast schedule on NBC, the show took a hiatus from August 9\u201317.", "The thirteenth season premiered on September 25, 2017, and was watched by 10.57 million viewers with a 2.6 in the 18-49 demographic. It is down from last season's premiere by 2.46 million viewers. The fourteenth season premiered on February 26, 2018, and was watched by 12.31 million viewers with a 2.8 in the 18-49 demographic. It is up from last season's premiere by 1.74 million viewers. The fifteenth season premiered on September 24, 2018, and was watched by 9.66 million viewers with a 2.0 in the 18-49 demographic. This is the lowest rated season premiere to date.", "The third season of America's Got Talent, an American television reality show talent competition, premiered on NBC on June 17, 2008. Opera singer Neal E. Boyd was named the winner on October 1, 2008. Preliminary auditions were held in New York, Dallas, Los Angeles, Atlanta, Chicago, and MySpace from January to April. David Hasselhoff, Piers Morgan and Sharon Osbourne returned as judges. Jerry Springer also returned as host. It premiered in the United Kingdom on the channel ITV2, 7 months after the United States premiere. It premiered in Singapore on Channel 5 in September 2008, and in Hong Kong on channel TVB Pearl on May 23, 2009.", "On February 13, 2017, Cannon announced he would not return as host for the twelfth season, citing creative differences between him and executives at NBC. The resignation came in the wake of news that the network considered firing Cannon after he made disparaging remarks about NBC in his Showtime comedy special \"Stand Up, Don't Shoot\". NBC selected Tyra Banks as the new host for season 12, which premiered on Tuesday, May 30, 2017. On September 20, Darci Lynne Farmer won the twelfth season, becoming the third ventriloquist, third child act and the third female act to win the competition (second year in a row after VanderWaal's win in 2016). Child singer Angelica Hale was announced as the runner-up, and Ukrainian dance act Light Balance finished in third place. Deaf musician Mandy Harvey and dog act Sara & Hero rounded out the top five."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[86, 98], [83, 98], [86, 99], [134, 146], [395, 407], [115, 131], [145, 157], [35, 53], [118, 131], [420, 432]], "rd_topk": 2}, "test_2081": {"question": "Who is the father of Lucius in gladiator", "answer": ["Lucius Verus"], "prediction": ["Charles Wagner", "Lucifer", "Sextus Julius Caesar", "Marcus", "Titus", "Marcus Vipsanius Agrippa", "Brutus Pera", "Faunus", "Marcus Vipsanius Agrippa", "General Aquilius Drusus,"], "score": [86.89421081542969, 85.81107330322266, 84.58417510986328, 83.94590759277344, 83.75613403320312, 82.7166748046875, 82.27149200439453, 81.98686218261719, 81.66716766357422, 81.53660583496094], "title": [["Lucius (video game)"], ["Lucius (video game)"], ["Lucius Julius Caesar (praetor 183 BC)"], ["Roman naming conventions"], ["Titus (film)"], ["Lucius Caesar"], ["Gladiator"], ["Latinus"], ["Lucius Caesar"], ["Gladiator Begins"]], "evidence": ["When Lucius was born on the date of June 6th, 1966, nobody expected him to be anything other than a normal little boy. His childhood, spent in the luxurious manor on the private estate of his father, Charles Wagner and his wife, Nancy, was as normal as every kid's young years, excluding the extreme wealth of his parents. The luxurious wealth his family has is, in part, due to Lucius's grandfather, Fabius's past ties to the mob. After celebrating on the night of his sixth birthday, he is visited by Lucifer, who instructs him to lock a maid in the freezer. While Lucius is asleep, he once again visits him, this time revealing himself to be Lucius's true father. Before sending him off, he gives Lucius a task: as part of a debt the family owes, Lucius must kill everyone who resides in the manor. The next morning, a detective, McGuffin, is sent to investigate the death.", "Lucius is a psychological horror stealth video game developed by Shiver Games and published by Lace Mamba Global for Microsoft Windows. It is centered on the six-year-old boy Lucius, who is the son of Lucifer. Players take control of Lucius as he murders members of his household, using powers of telekinesis and mind control to orchestrate deadly accidents that lead to the deaths of multiple residents of Dante Manor. Players use their wits and follow hints to ensure they do not leave any evidence that would lead to a mission failing. A sequel, \"Lucius II: The Prophecy\", was announced on August 8, 2014, and was released on February 2015. A second sequel, Lucius III, was announced on August 27, 2018.", "Lucius Julius Sex. f. L. n. Caesar was a member of the patrician house of the Julii Caesares at Ancient Rome, and held the office of praetor in 183 BC. Lucius was the son of Sextus Julius Caesar, who had distinguished himself as praetor in BC 208, during the Second Punic War. He had at least one brother, Sextus, who obtained the consulship in 157, and probably a second, Gaius, a senator who wrote a history of Rome in Greek about 143 BC. Although it was common for the eldest son in a family to be named after his father, Lucius, apparently named after his grandfather, was probably the eldest brother. Following the \"cursus honorum\", he was probably approaching forty years of age when he was elected praetor, and was probably born no later than 220 BC, while his brother, Sextus, first appears in history holding the rather junior post of military tribune in 181, and did not become consul for another twenty-four years after that. Further, Lucius had a son, also named Lucius, who was praetor in 166, and thus was probably born before BC 200; Sextus' son only obtained the praetorship in 123 BC.", "Apart from the praenomen, the \"filiation\" was the oldest element of the Roman name. Even before the development of the nomen as a hereditary surname, it was customary to use the name of a person's father as a means of distinguishing him or her from others with the same personal name; thus Lucius, the son of Marcus would be \"Lucius, Marci filius\"; Paulla, the daughter of Quintus, would be \"Paulla, Quinti filia\". Many nomina were derived in the same way, and most praenomina have at least one corresponding nomen, such as Lucilius, Marcius, Publilius, Quinctius, or Servilius. These are known as patronymic surnames, because they are derived from the name of the original bearer's father. Even after the development of the nomen and cognomen, filiation remained a useful means of distinguishing between members of a large family.", "Back in the Roman Arena, Lucius tells his family's story to the people and is proclaimed Emperor. He orders his father Titus and sister Lavinia to be buried in the family monuments, Saturninus be given a proper burial, Tamora's body to be thrown to the wild beasts, and Aaron be buried chest-deep and left to die of thirst and starvation. Aaron is unrepentant to the end. Young Lucius picks up Aaron's child and carries him away into the sunrise. Apart from the deliberate anachronisms, the film follows the play quite closely. One of the experimental concepts in the film was that the character of Young Lucius (Titus' grandson) is initially introduced as a boy from the present who finds himself transported to the fantastical reality of the film. At the beginning of the film, his toy soldiers turn into Titus' Roman army. At the end, when Titus' son Lucius avenges his father by condemning the villainous Aaron to a painful death, the boy takes pity on Aaron's infant son, carrying him away from the violence as he walks slowly into the sunrise. This ending is perhaps more positive than the ending of other productions of the play, including Taymor's stage production, in which Young Lucius is fixated upon the \"tiny black coffin\" holding the dead infant.", "Lucius was born in Rome in 17 BC to Marcus Vipsanius Agrippa and Julia. He was part of the imperial family of Augustus, known as the Julio-Claudian dynasty, and was related to all the Julio-Claudian emperors. On his mother's side, he was the second oldest grandson of emperor Augustus after his brother Gaius. He was the brother-in-law of Tiberius by his half-sister Vipsania Agrippina, and Claudius by his sister Agrippina the Elder's marriage to Germanicus. Lucius' nephew was the future emperor Caligula, who was Germanicus' son.", "Livy places the first Roman gladiator games (264 BC) in the early stage of Rome's First Punic War against Carthage, when Decimus Iunius Brutus Scaeva had three gladiator pairs fight to the death in Rome's \"cattle market\" Forum (\"Forum Boarium\") to honor his dead father, Brutus Pera. This is described as a \"munus\" (plural: \"munera\"), a commemorative duty owed the manes of a dead ancestor by his descendants. The development of the \"munus\" and its gladiator types was most strongly influenced by Samnium's support for Hannibal and the subsequent punitive expeditions against the Samnites by Rome and her Campanian allies; the earliest and most frequently mentioned type was the Samnite.", "In later Roman mythology (notably Virgil's \"Aeneid\"), Latinus, or Lavinius, was a king of the Latins. He is sometimes described as the son of Faunus and Marica, and father of Lavinia with his wife, Amata. He hosted Aeneas's army of exiled Trojans and offered them the chance to reorganize their life in Latium. His wife Amata wished his daughter Lavinia to be betrothed to Turnus, king of the Rutuli, but Faunus and the gods insisted that he give her instead to Aeneas; consequently, Turnus declared war on Aeneas and was killed two weeks into the conflict. Ascanius, the son of Aeneas, later founded Alba Longa and was the first in a long series of kings leading to Romulus and Remus, the founders of Rome. This version is not compatible with the Greek one: the Trojan War had ended only eight years earlier, and Odysseus only met Circe a couple of months later, so any son of the pair could only be seven years old, whereas the Roman Latinus had an adult daughter by then.", "Lucius Caesar (Latin: \"Lucius Julius Caesar\"; 17 BC \u2013 20 August AD 2) was the grandson of Augustus. The son of Marcus Vipsanius Agrippa and Julia the Elder, Augustus' only daughter, Lucius was adopted by his grandfather along with his older brother, Gaius Caesar. As the emperor's adopted sons and joint-heirs to the Roman Empire, Lucius and Gaius had promising political and military careers. However, Lucius died of a sudden illness on 20 August AD 2, in Massilia, Gaul, while traveling to meet the Roman army in Hispania. His brother Gaius also died at a relatively young age on 21 February, AD 4. The untimely loss of both heirs compelled Augustus to redraw the line of succession by adopting Lucius' younger brother, Agrippa Postumus as well as his stepson, Tiberius on 26 June AD 4.", "Sextus: A formidable, legendary gladiator, nicknamed the \"Honor of Rome\", who fights with a sharp gladius and a tall shield. Sextus is a warrior from Germania who once fought against General Aquilius Drusus, Aquilla's father, during the Germanic Wars. He lost and was then taken back as a slave to Rome, where he later became the most successful gladiator under the Drusus family's patronage. Despite his hatred for Rome, Sextus respects General Drusus and holds no grudge against him. The general did not kill prisoners and actually treated Sextus and his surviving comrades well. However, Sextus has vowed to never help the Drusus family directly since the general was still responsible for the deaths of his people."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[200, 214], [201, 208], [174, 194], [309, 315], [119, 124], [36, 60], [271, 282], [142, 148], [111, 135], [183, 207]], "rd_topk": 1}, "test_2082": {"question": "Who invented the submarine during the Civil War", "answer": ["Horace Lawson Hunley"], "prediction": ["John Philip Holland", "John Philip Holland", "David Bushnell", "Robert Whitehead", "Robert Fulton", "British engineer Robert Whitehead", "Isaac Peral", "Robert Fulton", "Robert Whitehead", "Josiah Hamilton Langdon Tuck"], "score": [95.78085327148438, 94.02772521972656, 93.74226379394531, 93.20394897460938, 92.7914047241211, 92.78990936279297, 92.64633178710938, 92.39035034179688, 92.27706909179688, 92.16810607910156], "title": [["History of the United States Navy"], ["History of submarines"], ["Military technology"], ["Submarine"], ["Torpedo"], ["Submarine"], ["Spanish submarine Peral"], ["Turtle (submersible)"], ["History of submarines"], ["Josiah Tuck"]], "evidence": ["The latest technological innovation of the time, submarines, were developed in the state of New Jersey by an Irish-American inventor, John Philip Holland. His submarine, was officially commissioned into U.S. Navy service in the fall of 1900. The Russo-Japanese War of 1905 and the launching of in the following year lent impetus to the construction program. At the end of 1907 Roosevelt had sixteen new battleships to make up his \"Great White Fleet\", which he sent on a cruise around the world. While nominally peaceful, and a valuable training exercise for the rapidly expanding Navy, it was also useful politically as a demonstration of United States power and capabilities; at every port, the politicians and naval officers of both potential allies and enemies were welcomed on board and given tours. The cruise had the desired effect, and American power was subsequently taken more seriously.", "The Irish inventor John Philip Holland built a model submarine in 1876 and a full scale one in 1878, followed by a number of unsuccessful ones. In 1896, he designed the Holland Type VI submarine. This vessel made use of internal combustion engine power on the surface and electric battery power for submerged operations. Launched on 17 May 1897 at Navy Lt. Lewis Nixon's Crescent Shipyard in Elizabeth, New Jersey, the Holland VI was purchased by the United States Navy on 11 April 1900, becoming the United States Navy's first commissioned submarine and renamed USS Holland.", "New financial tools were developed to fund the rapidly increasing costs of warfare, such as popular bond sales and income taxes, and the funding of permanent research centers. Many 19th century innovations were largely invented and promoted by lone individuals with small teams of assistants, such as David Bushnell and the submarine, John Ericsson and the battleship, Hiram Maxim and the machine gun, Ernest Swinton and the tank, and Alfred Nobel and high explosives. By 1900 the military began to realize that they needed to rely much more heavily on large-scale research centers, which needed government funding. They brought in leaders of organized innovation such as Thomas Edison in the U.S. and chemist Fritz Haber of the Kaiser Wilhelm Institute in Germany.", "The success of the submarine is inextricably linked to the development of the torpedo, invented by Robert Whitehead in 1866. His invention is essentially the same now as it was 140 years ago. Only with self-propelled torpedoes could the submarine make the leap from novelty to a weapon of war. Until the perfection of the guided torpedo, multiple \"straight-running\" torpedoes were required to attack a target. With at most 20 to 25 torpedoes stored on board, the number of attacks was limited. To increase combat endurance most World War I submarines functioned as submersible gunboats, using their deck guns against unarmed targets, and diving to escape and engage enemy warships. The importance of guns encouraged the development of the unsuccessful Submarine Cruiser such as the French and the Royal Navy's and M-class submarines. With the arrival of Anti-submarine warfare (ASW) aircraft, guns became more for defense than attack. A more practical method of increasing combat endurance was the external torpedo tube, loaded only in port.", "An early submarine, , attempted to lay a bomb with a timed fuse on the hull of during the American Revolutionary War, but failed in the attempt. In the early 1800s, the American inventor Robert Fulton, while in France, \"conceived the idea of destroying ships by introducing floating mines under their bottoms in submarine boats.\" He coined the term \"torpedo\" in reference to the explosive charges with which he outfitted his submarine \"Nautilus\". However, both the French and the Dutch governments were uninterested in the submarine. Fulton then concentrated on developing the torpedo independent of a submarine deployment. On 15 October 1805, while in England, Fulton put on a public display of his \"infernal machine\", sinking the brig \"Dorothea\" with a submerged bomb filled with of gunpowder and a clock set to explode in 18 minutes. However, the British government refused to purchase the invention, stating they did not wish to \"introduce into naval warfare a system that would give great advantage to weaker maritime nations.\" Fulton carried out a similar demonstration for the US government on 20 July 1807, destroying a vessel in New York's harbor. Further development languished as Fulton focused on his \"steam-boat matters\". During the War of 1812, torpedoes were employed in attempts to destroy British vessels and protect American harbors. In fact a submarine-deployed torpedo was used in an unsuccessful attempt to destroy while in New London's harbor. This prompted the British Captain Hardy to warn the Americans to cease efforts with the use of any \"torpedo boat\" in this \"cruel and unheard-of warfare\", or he would \"order every house near the shore to be destroyed.\"", "The submarine became a potentially viable weapon with the development of the Whitehead torpedo, designed in 1866 by British engineer Robert Whitehead, the first practical self-propelled or 'locomotive' torpedo. The spar torpedo that had been developed earlier by the Confederate navy was considered to be impracticable, as it was believed to have sunk both its intended target, and probably \"H. L. Hunley\", the submarine that deployed it. Discussions between the English clergyman and inventor George Garrett and the Swedish industrialist Thorsten Nordenfelt led to the first practical steam-powered submarines, armed with torpedoes and ready for military use. The first was \"Nordenfelt I\", a 56-tonne, vessel similar to Garrett's ill-fated \"Resurgam\" (1879), with a range of , armed with a single torpedo, in 1885.", "Peral was one of the first electric battery-powered submarines, built by the Spanish engineer and sailor Isaac Peral for the Spanish Navy. The first fully capable military submarine, she was launched 8 September 1888. She had one torpedo tube (and two torpedoes) and an air regeneration system. Her hull shape, propeller, and cruciform external controls anticipated later designs. Her underwater speed was . With fully charged batteries, she was the fastest submarine yet built, with underwater performance levels (except for range) that matched those of First World War U-boats for a very short period, before her batteries began to drain. For example, the SM U-9, a pre-war German U-boat built in 1908, had an underwater speed of 8.1kn, and an underwater range of at 5.8kn, before having to resurface to recharge her batteries. In June 1890, Peral's submarine launched a torpedo while submerged. It was also the first submarine to incorporate a fully reliable underwater navigation system. However, conservatives in the Spanish naval hierarchy terminated the project despite two years of successful tests. Her operational abilities have led some to call her the first U-boat.", "Despite \"Turtle\"'s shortcomings, Bushnell's invention marked an important milestone in submarine technology. The American inventor Robert Fulton conceived of his submarine \"Nautilus\" in the first years of the nineteenth century and took it to Europe when the United States proved largely uninterested in the design. During the American Civil War, the Confederate States of America, faced with a similar situation to that of the colonies during the War of Independence, developed an operational submarine CSS \"H.L. Hunley\", whose destruction of the USS \"Housatonic\" in Charleston Harbor in February 1864 was the first successful submarine attack in history. By the early-twentieth century, the world's navies were beginning to adopt submarines in larger numbers. Like Bushnell's design, these boats mimicked the natural forms of marine animals in their hull designs. As one contemporary historian of submarines observed in 1901, the evolution of modern submarine evolved from the whale, which he deemed a \"submarine made by nature out of a mammal.", "The submarine became a potentially viable weapon with the development of the first practical self-propelled torpedoes. The Whitehead torpedo was the first such weapon, and was designed in 1866 by British engineer Robert Whitehead. His 'mine ship' was an 11-foot long, 14-inch diameter torpedo propelled by compressed air and carried an explosive warhead. The device had a speed of and could hit a target away. Many naval services procured the Whitehead torpedo during the 1870s and it first proved itself in combat during the Russo-Turkish War when, on January 16, 1878, the Turkish ship \"Intibah\" was sunk by Russian torpedo boats carrying Whiteheads.", "Josiah Hamilton Langdon Tuck (October 12, 1824 \u2013 October 14, 1900) was an American inventor and pioneering submarine designer. In addition to his submarine work, Tuck was granted several other patents. Tuck was granted for a \"submarine vessel\" in 1884. His submarine prototype, the \"Peacemaker\", was tested with mixed success in 1884, 1885 and 1886 in New York's harbor. In its final form, it was powered by a chemical reaction based on caustic soda and it was armed with electrically fused buoyant \"torpedos\" (), explosive charges that were intended to be planted under enemy ships. In 1888, the US government announced a competition for submarine designs. Tuck submitted his design along with a number of other inventors, including John Philip Holland, Thorsten Nordenfelt and George C. Baker. Holland won the competition, but due to irregularities the contract was not awarded."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[134, 153], [19, 38], [301, 315], [99, 115], [187, 200], [116, 149], [105, 116], [131, 144], [213, 229], [0, 28]], "rd_topk": 2}, "test_2083": {"question": "Who's winning the election in Virginia for governor", "answer": ["Ralph Northam", "Democratic nominee Ralph Northam"], "prediction": ["Ralph Northam", "Justin Fairfax", "Democratic nominee Ralph Northam", "Democratic nominee Justin Fairfax", "Ralph Northam", "Ralph Northam", "Ralph Northam", "Ed Gillespie", "Ralph Northam", "Ralph Northam"], "score": [83.32414245605469, 82.0885009765625, 81.031005859375, 80.75080871582031, 79.73045349121094, 79.52576446533203, 79.45552062988281, 79.28785705566406, 78.51438903808594, 78.46122741699219], "title": [["2017 Virginia gubernatorial election"], ["2017 Virginia lieutenant gubernatorial election"], ["2017 Virginia gubernatorial election"], ["2017 Virginia lieutenant gubernatorial election"], ["Chesterfield County, Virginia"], ["Elections in Virginia"], ["Governor of Virginia"], ["Citizens for Responsible Energy Solutions"], ["2017 Virginia elections"], ["2017 Virginia elections"]], "evidence": ["In the general election on November 7, 2017, Democratic nominee Ralph Northam defeated Republican nominee Ed Gillespie, winning by the largest margin for a Democrat since 1985. Northam became the 73rd governor of Virginia, and assumed office on January 13, 2018. The election had the highest voter turnout percentage in a Virginia gubernatorial election in twenty years with 47% of the state's constituency casting their ballot. Virginia election laws allow for unlimited campaign contributions in state and local elections.", "The Virginia lieutenant gubernatorial election of 2017 was held on November 7, 2017. After the party primary elections were held, the major party nominees were Jill Vogel (Republican) and Justin Fairfax (Democrat). The incumbent Lieutenant Governor, Democrat Ralph Northam, declined to run for re-election in order to run for Governor. In the general election on November 7, 2017, Democratic nominee Justin Fairfax defeated Republican nominee Jill Vogel to become the 41st lieutenant-governor of Virginia.", "In the general election on November 7, 2017, Democratic nominee Ralph Northam defeated Republican nominee Ed Gillespie, winning by the largest margin for a Democrat since 1985. Northam became the 73rd governor of Virginia, and assumed office on January 13, 2018. The election had the highest voter turnout percentage in a Virginia gubernatorial election in twenty years with 47% of the state's constituency casting their ballot. Virginia election laws allow for unlimited campaign contributions in state and local elections.", "The Virginia lieutenant gubernatorial election of 2017 was held on November 7, 2017. After the party primary elections were held, the major party nominees were Jill Vogel (Republican) and Justin Fairfax (Democrat). The incumbent Lieutenant Governor, Democrat Ralph Northam, declined to run for re-election in order to run for Governor. In the general election on November 7, 2017, Democratic nominee Justin Fairfax defeated Republican nominee Jill Vogel to become the 41st lieutenant-governor of Virginia.", "Like most of Richmond's suburbs, Chesterfield County historically had a conservative voting pattern. The last time that the county voted for the Democratic candidate was in the 1948 presidential election when it supported President Harry S. Truman over the Republican nominee Thomas E. Dewey. However, since the early 2000s, recent elections have proved to be competitive both statewide and nationally in the county. Chesterfield narrowly supported President Donald J. Trump over former Secretary of State Hillary Clinton by a 2.2 percentage point margin\u2013the closest that a Democrat had come to winning the county in seven decades. In the 2017 Virginia gubernatorial election, Democrat Ralph Northam narrowly won the county over Republican Ed Gillespie.", "In the November 2010 federal elections, Republicans picked up three U.S. House seats previously held by Democrats, and proceeded to hold eight of Virginia's eleven seats, compared to three for Democrats. From 1977 until November 2013, Virginia had elected a governor of the opposite political party compared to the current President of the United States of the time. The current Governor of Virginia is Ralph Northam, who was inaugurated on January 13, 2018. Northern Virginia, Fairfax County in particular, has favored Democratic candidates in recent elections. This is likely due to the large migration of people from the liberal Northeastern states into the Washington Metropolitan Area (which includes Northern Virginia) as well as an increase in the minority population especially Latinos and Asians. John Kerry won Fairfax County, long a Republican stronghold, by 2.4% and generally fared better in the rest of Northern Virginia than Al Gore did in 2000. Despite this increase however, he still lost every other county with the exception of Arlington County in the Northern Virginia region in the 2004 election. In contrast to the changing voting trend in Northern Virginia, the majority of the rest of Virginia has been supportive of the Republican Party. Some portions of the state like college towns and the southeastern counties in the Black Belt Region have been more likely to vote Democratic.", "Since 1851, Virginia's gubernatorial elections have been held in \"off-years\"\u2014years in which there are no national (presidential, senatorial, or House) elections; Virginia's gubernatorial elections are held one year after U.S. presidential elections (2001, 2005, 2009, etc.) (Most states hold gubernatorial elections either on presidential-election years or midterm-election years, when there are congressional elections.) In every Virginia gubernatorial election starting with 1977, the governor elected had been from the opposite party as the president elected by the nation in the previous year, even when Virginia had voted for the president in office, as with Ronald Reagan and Barack Obama. The only exception being in 2013 with the election of Democrat Terry McAuliffe, following the re-election of President Obama in 2012. Tim Kaine was inaugurated on January 14, 2006. Due to renovations on the Capitol in Richmond, his inauguration was held in Williamsburg, making him the first governor to be inaugurated in Williamsburg since Thomas Jefferson in 1779. The current governor of Virginia is Ralph Northam, who was inaugurated on January 13, 2018. The Governor of Virginia is addressed as \"The Honorable\", but may occasionally be referred to as \"Excellency\" if ceremonially appropriate.", "CRES supports Republican elected officials who sponsor clean energy legislation in federal and state elections. In 2017, CRES endorsed Ed Gillespie for Governor of Virginia and Jill Vogel for Lieutenant Governor of Virginia. In 2016, CRES endorsed 29 candidates and spent $1.7 million on phone, radio and TV advertising in support of candidates for the U.S. Senate and House who have a track record of enacting renewable energy solutions. In the 2014 midterm election cycle, CRES endorsed eight candidates and supported their campaign efforts with more than $1.5 million.", "Ralph Northam won the election to become the 73rd Governor of Virginia with 53.7% of the popular vote. The Virginia lieutenant gubernatorial election of 2017 took place on November 7, 2017. The incumbent Lieutenant Governor, Democrat Ralph Northam, did not seek re-election in order to run for Governor. Justin Fairfax won the election to become the 41st Lieutenant Governor of Virginia with 52.7% of the popular vote. The Virginia Attorney General election of 2017 took place on November 7, 2017. The incumbent Attorney General, Democrat Mark Herring, ran for re-election to a second term.", "Statewide and municipal elections were held in the U.S. state of Virginia on November 7, 2017. The main election being held in Virginia was the state's gubernatorial election. In addition, all of Virginia's House of Delegates seats were up for re-election. Primary elections for the House of Delegates and the governor were held on June 13, 2017. Ralph Northam (D) was elected to become the 73rd Governor of Virginia, Justin Fairfax (D) was elected to become the 41st Lieutenant Governor of Virginia, and Mark Herring (D) was reelected as the 47th Attorney General of Virginia."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[64, 77], [400, 414], [45, 77], [381, 414], [686, 699], [403, 416], [1099, 1112], [135, 147], [0, 13], [347, 360]], "rd_topk": 6}, "test_2084": {"question": "When was the last time University of Michigan won a national Championship", "answer": ["1997"], "prediction": ["1997", "1989", "1997", "1997", "2013", "1989", "1998", "1962", "1997", "1989"], "score": [84.07450103759766, 79.7240219116211, 79.6546630859375, 79.60481262207031, 77.96345520019531, 77.52201843261719, 77.3421630859375, 77.27598571777344, 77.24856567382812, 77.16757202148438], "title": [["Michigan Wolverines football"], ["List of Michigan Wolverines men's basketball head coaches"], ["University of Michigan"], ["Michigan Wolverines"], ["Michigan Wolverines"], ["Steve Fisher"], ["Michigan Wolverines"], ["Michigan Wolverines baseball"], ["Brady Hoke"], ["Michigan Wolverines"]], "evidence": ["Michigan began competing in intercollegiate football in 1879. The Wolverines joined the Big Ten Conference at its inception in 1896, and other than a hiatus from 1907 to 1916, have been members since. Michigan has won or shared 42 league titles, and, since the inception of the AP Poll in 1936, has finished in the top 10 a total of 38 times. The Wolverines claim 11 national championships, most recently that of the 1997 squad voted atop the final AP Poll. From 1900 to 1989, Michigan was led by a series of nine head coaches, each of whom has been inducted into the College Football Hall of Fame either as a player or as a coach. Fielding H. Yost became Michigan's head coach in 1901 and guided his \"Point-a-Minute\" squads to a streak of 56 games without a defeat, spanning from his arrival until the season finale in 1905, including a victory in the 1902 Rose Bowl, the first college football bowl game ever played. Fritz Crisler brought his winged helmet from Princeton University in 1938 and led the 1947 Wolverines to a national title and Michigan's second Rose Bowl win. Bo Schembechler coached the team for 21 seasons (1969\u20131989) in which he won 13 Big Ten titles and 194 games, a program record. The first decade of his tenure was underscored by a fierce competition with his former mentor, Woody Hayes, whose Ohio State Buckeyes squared off against Schembechler's Wolverines in a stretch of the Michigan\u2013Ohio State rivalry dubbed the \"Ten-Year War\".", "Steve Fisher is the first and only head coach to have led the team to an NCAA Tournament championship, doing so in 1989. He also led the team to six other NCAA Tournament appearances, including two runner-up finishes in 1992 and 1993, but the '92 and '93 Final Fours were vacated as punishment for the University of Michigan basketball scandal. Before Fisher, Bill Frieder had led the team to four consecutive tournament appearances. Seven coaches have led the team to Big Ten Regular Season Championships: E. J. Mather, George Veenker, Ozzie Cowles, Dave Strack, Johnny Orr, Frieder, and John Beilein. Brian Ellerbe led the team to a Big Ten Tournament championship, but that victory was vacated in 2002 in wake of the scandal. , Beilein is the current head coach for the team. He has led the team to two Big Ten Regular Season Championships in 2012 and 2014 and two Big Ten Tournament Championships in 2017 and 2018. He has also led the team to eight NCAA tournament appearances, including four years in row from 2011\u201314. During these appearances, he led the team to two runner-up finishes in the tournament in 2013 and 2018, an Elite Eight appearance in 2014, and a Sweet Sixteen appearance in 2017 - Michigan had actually comprised a record of 1587\u20131038 (.605), but records from the 1992 NCAA Tournament Final Four, 1992\u201393, 1995\u201396, 1996\u201397, 1997\u201398 and 1998\u201399 seasons were vacated due to the University of Michigan basketball scandal.", "The Michigan football program ranks first in NCAA history in total wins (925 through the end of the 2015 season) and first among FBS schools in winning percentage (.731). The team won the first Rose Bowl game in 1902. U-M had 40 consecutive winning seasons from 1968 to 2007, including consecutive bowl game appearances from 1975 to 2007. The Wolverines have won a record 42 Big Ten championships. The program has 11 national championships, most recently in 1997, and has produced three Heisman Trophy winners: Tom Harmon, Desmond Howard and Charles Woodson.", "The Wolverines have won a record 929 games and have the most all-time wins and the highest winning percentage in college football history. Michigan won the inaugural Rose Bowl in 1902, the first college bowl game ever played. The Wolverine football program has claimed 11 national titles. Michigan's 11 national championships have come under the direction of five coaches. The first six were garnered by the team's first coaching superstar, Fielding H. Yost. Yost directed his \"Point-a-Minute\" teams to four consecutive national titles from 1901 to 1904, amassing a record of 41\u20130\u20131. Yost also led Michigan to national titles in 1918 and 1923. Yost was instrumental in the creation of Michigan Stadium and designed it to permit its expansion to expand to a capacity of over 150,000. Yost's legacy also lives on with Yost Ice Arena, where Michigan's men's ice hockey team plays their home games. Michigan football has won five more national titles since Yost permanently retired in 1926. The Wolverines won back-to-back titles under Harry Kipke in 1932 and 1933 and two more consecutive championships under Fritz Crisler and Bennie Oosterbaan in 1947 and 1948. Michigan won its most recent national title under Lloyd Carr in 1997.", "Men's swimming and diving has been a varsity sport at Michigan since 1921. With 19 NCAA national championships (7 were unofficial), including the 2013 NCAA championship, the Michigan men's swimming and diving team has won more national championships than any other varsity sport in the history of the university. In addition to its 19 national championships, the team has finished in the Top 5 nationally 48 times. The team's swimmers have also won 145 individual NCAA championships. Three head coaches have led the squad for a combined 77 years: Matt Mann (1925\u201354), Gus Stager (1954\u201382) and Jon Urbanchek (1982\u20132004). Michigan swimmers and divers inducted into the International Swimming Hall of Fame include Mike Barrowman, Dick Degener, Tom Dolan, Taylor Drysdale, Bruce Harlan, Harry Holiday, Dick Kimball, Carl Robie, and Bob Webster. Mike Bottom took over as the team's head coach in 2008. In his first season as the team's head coach, Bottom led the Wolverines to a Big Ten championship and a 7th-place finish at the NCAA championship. In 2013, Bottom won the program's 12th official NCAA national championship (19th overall) and its first since 1995.", "Stephen Louis Fisher (born March 24, 1945) is a retired American basketball coach. Fisher has served as the head coach at the University of Michigan, where he won the national championship in 1989, and was an assistant at Michigan, Western Michigan University, and the Sacramento Kings of the National Basketball Association. From 1999 to 2017, Fisher was head coach at San Diego State. Fisher attended Illinois State University, where he helped lead the Redbirds to the Final Four of the 1967 NCAA College Division Basketball Tournament.", "The Wolverines ice hockey team, which was a member of the Central Collegiate Hockey Association until 2013 and is now a member of the Big Ten Conference, plays its home contests at Yost Ice Arena. The hockey team was coached by Red Berenson, a former UM player and is currently coached by Mel Pearson. Altogether, the program has won nine NCAA national championships (1948, 1951, 1952, 1953, 1955, 1956, 1964, 1996, 1998), which is also an NCAA record. In 2011, the team was invited to the NCAA tournament for a record 21st year in a row. In 2011, Michigan reached the national semi-finals (now referred to as the \"Frozen Four\") for an unmatched 24th time.", "The Michigan Wolverines baseball team represents the University of Michigan in NCAA Division I college baseball. Along with most other Michigan athletic teams, the baseball team participates in the Big Ten Conference. They play their home games at Ray Fisher Stadium. The Wolverines have made the College World Series seven times, winning two national championships in 1953 and 1962. Michigan is the fourth winningest program in NCAA Division I baseball history, trailing only Fordham, Texas and USC.", "In February 1995, Hoke was hired as an assistant coach at the University of Michigan under head coach Gary Moeller. He was the defensive end coach in 1995 and 1996 and defensive line coach from 1997 to 2002. In May 2002, Michigan head coach Lloyd Carr named Hoke as associate head coach, the only member of the staff with that distinction. At the time, Hoke told the press, \"Every year you learn more and more what the head coach has to do. I'm very honored to represent this school. I grew up a big Michigan fan, and I think it's a place that's special in a lot of ways.\" During Hoke's eight years at Michigan, the Wolverines compiled a 75\u201323 record, went to a bowl game every year and won the national championship in 1997. While at Michigan, Hoke was assigned to recruit in California. One of the players Hoke recruited to Michigan was future legendary NFL quarterback Tom Brady. Hoke recalled: \"Tom wasn't the greatest athlete, with those skinny legs, but there was something about him.\"", "The men's basketball team plays its games at Crisler Center. The Wolverines have won 14 Big Ten regular season titles, as well as the inaugural Big Ten Tournament in 1998, which it later forfeited due to NCAA violations. The team has appeared in the NCAA Final Four on eight occasions (1964, 1965, 1976, 1989, 1992*, 1993*, 2013, 2018) and won the National Championship in 1989 under Steve Fisher. The program later vacated its 1992 and 1993 Final Four appearances due to NCAA violations. Other notable players who played for Michigan include Roy Tarpley, Loy Vaught, Gary Grant, Terry Mills, Glen Rice, Jalen Rose, Rumeal Robinson, Rickey Green, Phil Hubbard, Jamal Crawford, Juwan Howard, Chris Webber, Jimmy King, Ray Jackson, Cazzie Russell, Daniel Horton, Campy Russell, and Mark Hughes."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[417, 421], [115, 119], [458, 462], [1224, 1228], [146, 150], [192, 196], [416, 420], [378, 382], [720, 724], [373, 377]], "rd_topk": 4}, "test_2085": {"question": "Who wrote got this feeling in my body", "answer": ["Johan Schuster", "Justin Timberlake", "Max Martin"], "prediction": ["Elvis Presley", "Dennis Linde", "Presley", "Linde", "Holland\u2013Dozier\u2013Holland", "Paul McCartney", "Baker Knight", "Dominique Durand", "James Brown", "Billy Currington."], "score": [81.31922912597656, 81.31868743896484, 79.22360229492188, 77.96013641357422, 76.51239776611328, 75.6822280883789, 75.6448974609375, 75.5073471069336, 74.81407928466797, 73.64801025390625], "title": [["I Got a Feelin' in My Body"], ["I Got a Feelin' in My Body"], ["I Got a Feelin' in My Body"], ["I Got a Feelin' in My Body"], ["I Got a Feeling"], ["I've Got a Feeling"], ["I Got a Feeling (Ricky Nelson song)"], ["I've Got a Feeling (Ivy song)"], ["I Got the Feelin'"], ["I Got a Feelin' (Billy Currington song)"]], "evidence": ["\"I Got a Feelin' in My Body\" is a song by Elvis Presley from his 1974 album \"Good Times\". In 1979, it was released posthumously on the reverse side of the single \"There's a Honky Tonk Angel (Who Will Take Me Back In)\". The single reached number 6 in the \"Billboard\" Country Singles Chart. The song was written by Dennis Linde. Presley recorded it on December 10 during the December 10\u201316, 1973 studio sessions for RCA at the Stax Studios in Memphis, Tennessee. Its first release on record was on the album \"Good Times in 1974. 7\" single", "\"I Got a Feelin' in My Body\" is a song by Elvis Presley from his 1974 album \"Good Times\". In 1979, it was released posthumously on the reverse side of the single \"There's a Honky Tonk Angel (Who Will Take Me Back In)\". The single reached number 6 in the \"Billboard\" Country Singles Chart. The song was written by Dennis Linde. Presley recorded it on December 10 during the December 10\u201316, 1973 studio sessions for RCA at the Stax Studios in Memphis, Tennessee. Its first release on record was on the album \"Good Times in 1974. 7\" single", "\"I Got a Feelin' in My Body\" is a song by Elvis Presley from his 1974 album \"Good Times\". In 1979, it was released posthumously on the reverse side of the single \"There's a Honky Tonk Angel (Who Will Take Me Back In)\". The single reached number 6 in the \"Billboard\" Country Singles Chart. The song was written by Dennis Linde. Presley recorded it on December 10 during the December 10\u201316, 1973 studio sessions for RCA at the Stax Studios in Memphis, Tennessee. Its first release on record was on the album \"Good Times in 1974. 7\" single", "\"I Got a Feelin' in My Body\" is a song by Elvis Presley from his 1974 album \"Good Times\". In 1979, it was released posthumously on the reverse side of the single \"There's a Honky Tonk Angel (Who Will Take Me Back In)\". The single reached number 6 in the \"Billboard\" Country Singles Chart. The song was written by Dennis Linde. Presley recorded it on December 10 during the December 10\u201316, 1973 studio sessions for RCA at the Stax Studios in Memphis, Tennessee. Its first release on record was on the album \"Good Times in 1974. 7\" single", "\"I Got a Feeling\" is a song recorded by American Motown vocal group Four Tops for their 1966 album, \"On Top\". It was written by Holland\u2013Dozier\u2013Holland and produced by Brian Holland and Lamont Dozier. In 1967, \"I Got a Feeling\" was covered by Barbara Randolph. This version was produced by Hal Davis and released as a single in 1967. British singer Lisa Stansfield covered \"I Got a Feeling\" in 1983 and released it as a single in the United Kingdom. Her version was produced by David Pickerill. The single's B-side included \"Red Lights,\" another song recorded by Stansfield. \"I Got a Feeling\" was never included on any of Stansfield's albums but \"Red Lights\" was featured on the \"In Session\" in 1996. UK 7\" single", "\"I've Got a Feeling\" is a song by the Beatles, from the 1970 album \"Let It Be\", recorded at the Beatles' rooftop concert on 30 January 1969. It is a combination of two unfinished songs: Paul McCartney's \"I've Got a Feeling\", and John Lennon's \"Everybody Had a Hard Year\". The song features Billy Preston on electric piano. A studio take of the song, recorded about a week earlier, was released on the \"Anthology 3\" compilation in 1996. The 2003 remix album \"Let It Be... Naked\" includes a version of the song that is a composite edit of the rooftop concert take used on \"Let It Be\" and a second attempt at the song from the same concert.", "\"I Got a Feeling\" is a song written by Baker Knight and performed by Ricky Nelson. The song reached #10 on the \"Billboard\" Hot 100 and #27 in the UK in 1958. The song is ranked #67 on \"Billboard\" magazine's Top 100 songs of 1958.", "\"I've Got a Feeling\" was written by Dominique Durand, Adam Schlesinger and Andy Chase, with Lloyd Cole and Peter Nashel handling additional production. Paul Q. Kolderie and Sean Slade served as the track's mixers, with Matthew Ellard's role being an assistant to them, and Bob Ludwig finalized the mastering. It is a pop song, supported by a horn section influenced by 1960s-style harmonies. Durand's vocals in \"I've Got a Feeling\" are light and subtle; according to \"Billboard\"s Larry Flick, they do not include any \"unnecessary posturing or vocal noodling\". The lyrics reference the feeling of falling in love. According to the liner notes of an advanced release of \"Apartment Life\", the band members wanted to create compositions that followed their \"trademark guitar-based arrangements\" with additional instrumentation; a majority of the aforementioned production comes from multiple layers of guitars.", "\"I Got the Feelin'\" is a funk song by James Brown. Released as a single in 1968, it reached #1 on the R&B chart and #6 on the pop chart. It also appeared on a 1968 album of the same name. The Jackson 5 auditioned for Motown founder Berry Gordy in 1968 with a filmed performance of \"I Got the Feelin'\", with the ten-year-old Michael Jackson closely mimicking Brown's vocal style and dance moves. In 1986, the song was prominently featured in the third-season episode of \"The Cosby Show\" entitled \"Golden Anniversary\", with most of the cast performing a lip-synch routine led by a 16-year-old Malcolm-Jamal Warner. A version of the song is featured in the musical \"Fela!\". It was also featured in \"Dead Presidents and Undercover Brother.\" \"with the James Brown Orchestra:\"", "\"I Got a Feelin'\" is a song co-written and recorded by American country music singer Billy Currington. It was released in January 2004 as the second and final single from his 2003 self-titled debut album. The song peaked at number 5 on the U.S. \"Billboard\" Hot Country Songs chart in mid-2004. It also reached number 50 on the \"Billboard\" Hot 100. Currington wrote this song with Casey Beathard and Carson Chamberlain. In his review of the album, Jeffrey B. Remz of \"Country Standard Time\" viewed the song favorably, saying that it showed Currington's traditional country sound by the prominence of fiddle (played by Stuart Duncan). The music video for \"I Got a Feelin'\" co-stars Gena Lee Nolin. \"I Got a Feelin'\" debuted at number 53 on the U.S. \"Billboard\" Hot Country Singles & Tracks chart for the week of January 17, 2004."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[42, 55], [313, 325], [48, 55], [320, 325], [128, 150], [186, 200], [39, 51], [36, 52], [38, 49], [85, 102]], "rd_topk": 1}, "test_2086": {"question": "Who was elected Senator of Illinois in 1858", "answer": ["Stephen A. Douglas"], "prediction": ["Stephen A. Douglas", "James Shields", "Senator Stephen A. Douglas", "Stephen A. Douglas", "Abraham Lincoln", "Stephen Douglas", "James S. Green", "Abraham Lincoln", "Stephen A. Douglas", "Charles H. Percy"], "score": [88.91722106933594, 88.26757049560547, 85.37469482421875, 84.97920227050781, 83.80351257324219, 83.69905090332031, 83.58782196044922, 83.18353271484375, 82.87734985351562, 82.8355712890625], "title": [["1856 Democratic National Convention"], ["2014 United States Senate election in New Hampshire"], ["1856 Democratic National Convention"], ["Quincy, Illinois"], ["Archibald Williams (judge)"], ["Chicago"], ["David Rice Atchison"], ["Thaddeus Stevens"], ["Samuel Snowden Hayes"], ["Rockefeller Republican"]], "evidence": ["June 4 saw the adoption of a platform (former National Committee chair Benjamin F. Hallett headed the committee on resolutions); the domestic portions were supported unanimously, the foreign policy planks by large margins. A separately reported plank on a railroad to the Pacific coast failed by a vote of 120 to 154. On June 5, the New York problem was finally settled by seating half of each of the competing delegations. Nominations for President were then made. The four men nominated were all at one time or another nominated by the party for the Chief Executive office: James Buchanan of Pennsylvania (nominated in 1856), President Franklin Pierce of New Hampshire (1852), Senator Stephen A. Douglas, of Illinois (1860), and Senator Lewis Cass of Michigan (1848). On the first ballot, Buchanan led with 135\u00bd votes. Pierce had 122\u00bd, Douglas 33, and Cass 5 (4 from the unhappy California delegation). The fourteen ballots taken that day saw Pierce's totals fall, mostly to the benefit of Senator Douglas.", "Brown was seeking to become only the third person in history and the first in 135 years to represent more than one state in the United States Senate. Waitman T. Willey represented Virginia from 1861 to 1863 and West Virginia from 1863 to 1871 and James Shields represented Illinois from 1849 to 1855, Minnesota from 1858 to 1859 and Missouri in 1879. Since the 17th Amendment, which provides for the popular election of Senators as opposed to state legislatures, was ratified in 1913, Brown would have been the first person popularly elected to two different states in the Senate.", "June 4 saw the adoption of a platform (former National Committee chair Benjamin F. Hallett headed the committee on resolutions); the domestic portions were supported unanimously, the foreign policy planks by large margins. A separately reported plank on a railroad to the Pacific coast failed by a vote of 120 to 154. On June 5, the New York problem was finally settled by seating half of each of the competing delegations. Nominations for President were then made. The four men nominated were all at one time or another nominated by the party for the Chief Executive office: James Buchanan of Pennsylvania (nominated in 1856), President Franklin Pierce of New Hampshire (1852), Senator Stephen A. Douglas, of Illinois (1860), and Senator Lewis Cass of Michigan (1848). On the first ballot, Buchanan led with 135\u00bd votes. Pierce had 122\u00bd, Douglas 33, and Cass 5 (4 from the unhappy California delegation). The fourteen ballots taken that day saw Pierce's totals fall, mostly to the benefit of Senator Douglas.", "The matter of slavery was a major religious and social issue in Quincy's early years. The Illinois city's location, separated only by the Mississippi River from the slave state of Missouri, which was a hotbed of political controversy on the issue, made Quincy itself a hotbed of political controversy on slavery. Dr. Richard Eells, who was a staunch abolitionist, built his home in Quincy in 1835 and sheltered runaway slaves on their way to Chicago. His home became a major stop on the Underground Railroad. The divide over slavery climaxed in 1858, when Quincy hosted the sixth Senatorial debate by U.S. Senator Stephen A. Douglas and his challenger, Abraham Lincoln. With an estimated crowd of 12,000 in attendance, Quincy was the largest community at which Lincoln and Douglas debated.", "At Bloomington, Williams, Browning, and Lincoln made \"No slavery in the territories\" the watchword of an emerging state political party that previously had abolitionist tendencies. In 1858, at a state party convention in Springfield, Illinois, Abraham Lincoln was nominated to be the Republican candidate for U.S. Senator from Illinois. A resolution passed at the convention stated that Lincoln \"was the first and only choice of the Republicans of Illinois for the U.S. Senate.\" In the famous Lincoln-Douglas debates in the 1858 Illinois U.S. Senate race, Democratic candidate Stephen Douglas attacked Lincoln three times for having been described as \"the first and only choice\" of Illinois Republicans for the Senate seat. All three times, Douglas pointed to Archibald Williams as an Illinois Republican who would have been an acceptable alternate choice to Lincoln in that contest.", "A flourishing economy brought residents from rural communities and immigrants from abroad. Manufacturing and retail and finance sectors became dominant, influencing the American economy. The Chicago Board of Trade (established 1848) listed the first-ever standardized \"exchange-traded\" forward contracts, which were called futures contracts. In the 1850s, Chicago gained national political prominence as the home of Senator Stephen Douglas, the champion of the Kansas\u2013Nebraska Act and the \"popular sovereignty\" approach to the issue of the spread of slavery. These issues also helped propel another Illinoisan, Abraham Lincoln, to the national stage. Lincoln was nominated in Chicago for US President at the 1860 Republican National Convention, which was held in Chicago in a temporary building called the Wigwam. He defeated Douglas in the general election, and this set the stage for the American Civil War.", "Atchison not only makes it clear the men are to kill and draw blood, he tells the men they will be \"well paid\" and encourages them to plunder from the homes they invade. This was after the hundreds of dozens of tortures and killings Charles Sumner had detailed in his Crimes Against Kansas speech. In other words, things were about to get much worse, now that Atchison had his hired men from Texas. Atchison's Senate term expired on March 3, 1855. He sought election to another term, but the Democrats in the Missouri legislature were split between him and Benton, while the Whig minority put forward their own man. No Senator was elected until January 1857, when James S. Green was chosen.", "Out of office, Stevens concentrated on the practice of law in Lancaster, remaining one of the leading attorneys in the state. He stayed active in politics, and in 1854, to gain more votes for the anti-slavery movement, he joined the nativist Know Nothing Party. The members were pledged not to speak of party deliberations (thus, they knew nothing), and Stevens was attacked for his membership in a group with similar rules of secrecy as the Masons. In 1855, Stevens joined the new Republican Party. Other former Whigs who were anti-slavery joined as well, including William H. Seward of New York, Charles E. Sumner of Massachusetts, and Abraham Lincoln of Illinois.", "Samuel Snowden Hayes (December 25, 1820 \u2013 January 28, 1880) was an American politician from Tennessee. Hayes moved to Illinois after a family tragedy and eventually established a successful law practice in Carmi. He became a prominent politician in White County, serving two terms in the Illinois House of Representatives and attending the 1848 state constitutional convention. He was a staunch supporter of the Democratic Party and often campaigned on their behalf. He moved to Chicago, Illinois in 1850 and became one of the city's leading Democratic voices preceding the Civil War. From 1858, he supported Stephen A. Douglas and championed him at the 1860 Democratic National Convention. He was one of the three delegates on the United States Revenue Commission in 1865.", "Other prominent figures in the GOP's Rockefeller-wing included Pennsylvania Governor Raymond P. Shafer, Pennsylvania Senator Hugh Scott, Illinois Senator Charles H. Percy, Oregon Senator Mark Hatfield, Arkansas Governor Winthrop Rockefeller, Nelson's younger brother (who was somewhat of an aberration in a conservative, heavily Democratic Southern state) and according to some also President Richard Nixon. After Vice President Rockefeller left the national stage in 1976, this faction of the party was more often called \"moderate Republicans\" or Nixonians, in contrast to the conservatives who rallied to Ronald Reagan. Rockefeller Republicans included moderates such as Senator Margaret Chase Smith and liberals such as Jacob Javits."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[687, 705], [247, 260], [679, 705], [614, 632], [244, 259], [424, 439], [664, 678], [638, 653], [609, 627], [154, 170]], "rd_topk": 4}, "test_2087": {"question": "Where is the University of Wisconsin Madison located", "answer": ["Madison , Wisconsin"], "prediction": ["Madison, Wisconsin", "in Madison, Wisconsin", "Madison, Wisconsin", "Madison", "University of Wisconsin in Madison", "University of Wisconsin", "Madison, WI", "Madison, Wisconsin", "Manitowoc, Wisconsin", "Green Bay, Wisconsin"], "score": [97.02755737304688, 93.30841064453125, 90.9756088256836, 90.4403305053711, 90.30721282958984, 90.08660125732422, 89.78543090820312, 87.97364807128906, 87.83407592773438, 87.1170654296875], "title": [["University of Wisconsin\u2013Madison"], ["University of Wisconsin\u2013Madison"], ["American Higher Education Development"], ["American urban history"], ["American urban history"], ["American urban history"], ["David Muir"], ["University of Wisconsin Law School"], ["UW-Green Bay, Manitowoc Campus"], ["University of Wisconsin\u2013Green Bay"]], "evidence": ["The University of Wisconsin\u2013Madison (also known as University of Wisconsin, Wisconsin, UW, regionally as UW\u2013Madison, or simply Madison) is a public research university in Madison, Wisconsin. Founded when Wisconsin achieved statehood in 1848, UW\u2013Madison is the official state university of Wisconsin, and the flagship campus of the University of Wisconsin System. It was the first public university established in Wisconsin and remains the oldest and largest public university in the state. It became a land-grant institution in 1866. The main campus, located on the shores of Lake Mendota, includes four National Historic Landmarks. The University also owns and operates a historic arboretum established in 1932, located south of the main campus.", "The University of Wisconsin\u2013Madison (also known as University of Wisconsin, Wisconsin, UW, regionally as UW\u2013Madison, or simply Madison) is a public research university in Madison, Wisconsin. Founded when Wisconsin achieved statehood in 1848, UW\u2013Madison is the official state university of Wisconsin, and the flagship campus of the University of Wisconsin System. It was the first public university established in Wisconsin and remains the oldest and largest public university in the state. It became a land-grant institution in 1866. The main campus, located on the shores of Lake Mendota, includes four National Historic Landmarks. The University also owns and operates a historic arboretum established in 1932, located south of the main campus.", "American Higher Education Development Corporation (AHED) is an owner of post-secondary educational institutions including East West College of Natural Medicine in Sarasota, Florida; Madison Media Institute in Madison, Wisconsin; Minneapolis Media Institute in Edina, Minnesota; Rockford Career College in Rockford, Illinois; Stautzenberger College in Maumee, Ohio and Brecksville, Ohio; and The Stautzenberger Institute in Allen Park, Michigan. James M. Devaney founded the company in 1998 and Stephen Tave is its current President and Chief Executive Officer.", "America's financial, business and cultural leadership (that is, literature, the arts, and the media) were concentrated in the three or four largest cities. Political leadership was never concentrated. It was divided between Washington and the state capitals, and many states deliberately moved their state capital out of their largest city, including New York, Pennsylvania, Michigan, Illinois, Missouri, South Carolina, Louisiana, Texas and California. Academic and scientific leadership was weak in the United States until the late 19th century, when it began to be concentrated in universities. A few major research-oriented schools were in or close by the largest cities, such as Harvard (Boston), Columbia (New York), Johns Hopkins (Baltimore) and Chicago. However, most were located in smaller cities or large towns such as Yale in New Haven, Connecticut; Cornell in Ithaca, New York; Princeton in Princeton, New Jersey; the University of Michigan in Ann Arbor; University of Illinois in Urbana; University of Wisconsin in Madison; University of California in Berkeley, and Stanford in the village of Stanford, California.", "America's financial, business and cultural leadership (that is, literature, the arts, and the media) were concentrated in the three or four largest cities. Political leadership was never concentrated. It was divided between Washington and the state capitals, and many states deliberately moved their state capital out of their largest city, including New York, Pennsylvania, Michigan, Illinois, Missouri, South Carolina, Louisiana, Texas and California. Academic and scientific leadership was weak in the United States until the late 19th century, when it began to be concentrated in universities. A few major research-oriented schools were in or close by the largest cities, such as Harvard (Boston), Columbia (New York), Johns Hopkins (Baltimore) and Chicago. However, most were located in smaller cities or large towns such as Yale in New Haven, Connecticut; Cornell in Ithaca, New York; Princeton in Princeton, New Jersey; the University of Michigan in Ann Arbor; University of Illinois in Urbana; University of Wisconsin in Madison; University of California in Berkeley, and Stanford in the village of Stanford, California.", "America's financial, business and cultural leadership (that is, literature, the arts, and the media) were concentrated in the three or four largest cities. Political leadership was never concentrated. It was divided between Washington and the state capitals, and many states deliberately moved their state capital out of their largest city, including New York, Pennsylvania, Michigan, Illinois, Missouri, South Carolina, Louisiana, Texas and California. Academic and scientific leadership was weak in the United States until the late 19th century, when it began to be concentrated in universities. A few major research-oriented schools were in or close by the largest cities, such as Harvard (Boston), Columbia (New York), Johns Hopkins (Baltimore) and Chicago. However, most were located in smaller cities or large towns such as Yale in New Haven, Connecticut; Cornell in Ithaca, New York; Princeton in Princeton, New Jersey; the University of Michigan in Ann Arbor; University of Illinois in Urbana; University of Wisconsin in Madison; University of California in Berkeley, and Stanford in the village of Stanford, California.", "In March 2016, Muir released a year-long report on the heroin crisis in America, winning a CINE Golden Eagle Award for his reporting. Muir delivered the commencement address at Ithaca College in New York in May 2011, during which he urged graduates to use their voices. On March 13, 2015, Muir received an honorary Doctor of Letters degree and the Jessica Savitch Award of Distinction for Excellence in Journalism from Ithaca College. On May 8, 2015, Muir delivered the commencement address at Northeastern University in Massachusetts. During the ceremony, he was given an honorary Doctor of Media degree. On May 12, 2018, Muir delivered the commencement address at the University of Wisconsin-Madison in Madison, WI.", "The University of Wisconsin Law School is the professional school for the study of law at the University of Wisconsin\u2013Madison in Madison, Wisconsin. The law school was founded in 1868. The law school is located on Bascom Hill, the center of the UW\u2013Madison campus. In 1996, it completed a major renovation project that joined two previous buildings and created a four-story glass atrium. The renovation was recognized by the American Institute of Architects for its innovative design, incorporating modern design into the 150 years of architecture on historic Bascom Hill. In addition to lecture halls and smaller classrooms, the law school contains a fully functional trial courtroom, appellate courtroom, and an extensive law library. The library is noted for the 1942 mural \"The Freeing of the Slaves\" by John Steuart Curry that dominates the Quarles & Brady Reading Room (also known as the \"Old Reading Room\").", "The University of Wisconsin-Green Bay, Manitowoc Campus or UW-Green Bay, Manitowoc Campus is a two-year campus of the University of Wisconsin System located in Manitowoc, Wisconsin. It is part of the University of Wisconsin-Green Bay. Enrollment was 525 in fall, 2014. The University of Wisconsin System has had a presence in Manitowoc since 1933, when 26 students enrolled in a UW English class offered at the Vocational School located downtown on Clark Street. In July 2018 the UW System was restructured so that UW-Manitowoc became a UW-Green Bay campus. In August 2018 the name was officially changed to University of Wisconsin-Green Bay, Manitowoc Campus or UW-Green Bay, Manitowoc Campus.", "The University of Wisconsin-Green Bay (also known as UW-Green Bay or UWGB) is a public university located in Green Bay, Wisconsin, United States. Founded in 1965, it is part of the University of Wisconsin System. Since its founding, the school had an environmental sustainability emphasis (nicknamed \"Eco U\" in the 1970s by Newsweek), and offers associate's, bachelor's and master's degree programs. The university's mascot is the Phoenix. As of Fall 2016, student enrollment was approximately 7,030, including 6,758 undergraduate students. The freshman average ACT score was 22.6, with a high school GPA of 3.33."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[171, 189], [168, 189], [209, 227], [1029, 1036], [1002, 1036], [1002, 1025], [705, 716], [129, 147], [160, 180], [109, 129]], "rd_topk": 3}, "test_2088": {"question": "In Texas How is the Commissioner of insurance placed in office", "answer": ["Appointed"], "prediction": ["state constitution or by statute", "statute", "individually", "state constitution", "statute", "state law", "appointed by the Governor", "elected executive office position", "appointed", "state-by-state basis"], "score": [78.86238098144531, 78.65087890625, 78.52476501464844, 77.85383605957031, 77.56642150878906, 76.65608978271484, 76.65292358398438, 76.19205474853516, 76.07365417480469, 75.75594329833984], "title": [["Insurance commissioner"], ["Insurance law"], ["Insurance commissioner"], ["Insurance commissioner"], ["Government of the State of Washington"], ["National Conference of Insurance Guaranty Funds"], ["Florida Public Service Commission"], ["California Insurance Commissioner"], ["Insurance commissioner"], ["With-profits policy"]], "evidence": ["An insurance commissioner (or commissioner of insurance) is a public official in the executive branch of a state or territory in the United States who, along with his or her office, regulate the insurance industry. The powers granted to the office of an insurance commissioner differ in each state. The office of an insurance commissioner is established either by the state constitution or by statute. While most insurance commissioners are appointed, in some jurisdictions they are elected. The office of the insurance commissioner may be part of a larger regulatory agency, or an autonomous department.", "In the United States each state typically has a statute creating an administrative agency. These state agencies are typically called the Department of Insurance, or some similar name, and the head official is the Insurance Commissioner, or a similar titled officer. The agency then creates a group of administrative regulations to govern insurance companies that are domiciled in, or do business in the state. In the United States regulation of insurance companies is almost exclusively conducted by the several states and their insurance departments. The federal government has explicitly exempted insurance from federal regulation in most cases.", "Insurance law and regulation is established individually by each state. In order to better coordinate insurance regulation among the states and territories, insurance commissioners are members of the National Association of Insurance Commissioners (NAIC). The purpose of insurance commissioners is to maintain fair pricing for insurance products, protecting the solvency of insurance companies, preventing unfair practices by insurance companies, and ensuring availability of insurance coverage. In order to accomplish these goals, each state grants several powers to insurance commissioners and their offices, including: As of April 18. 2017, the various insurance commissioners are:", "An insurance commissioner (or commissioner of insurance) is a public official in the executive branch of a state or territory in the United States who, along with his or her office, regulate the insurance industry. The powers granted to the office of an insurance commissioner differ in each state. The office of an insurance commissioner is established either by the state constitution or by statute. While most insurance commissioners are appointed, in some jurisdictions they are elected. The office of the insurance commissioner may be part of a larger regulatory agency, or an autonomous department.", "The offices of each of the state constitutional officers are established in the Washington constitution, with the exception of that of the Insurance Commissioner, which was created by statute. They are each elected on a partisan ballot to concurrent four-year terms, except for the Superintendent of Public Instruction who is officially non-partisan. The \"Washington State Register\" (WSR) is a biweekly publication that includes activities of the government. The \"Washington Administrative Code\" (WAC) is the codification of regulations arranged by subject and agency.", "The National Conference of Insurance Guaranty Funds (NCIGF) is a nonprofit national insurance group that supports the United States\u2019 property and casualty insurance guaranty funds. An insurance consumer protection mechanism, property and casualty guaranty funds step in to pay covered insurance claims (which would otherwise go partially or entirely unpaid) of policyholders of an insolvent insurer at levels determined by state law. This ensures policyholders and claimants at greatest risk are protected from the most severe consequences of an insurer\u2019s failure.", "A Commissioner is appointed by the Governor and confirmed by the Senate. Commissioners serve terms of four years. Prior to 1979, three Commissioners were elected in a statewide election. The 1978 Legislature changed the Commission to a five-member appointed board. The Chairman is the chief administrative officer of the Commission, presiding at all hearings and conferences when present, setting Commission hearings, and performing those duties prescribed by law. The Chairman is elected by the Commission.", "California Insurance Commissioner has been an elected executive office position in California since 1991. Prior to that time, the Insurance Commissioner was appointed by the Governor. The officeholder is in charge of the California Department of Insurance. The current Insurance Commissioner is Democrat Dave Jones. As a result of the passage of Proposition 103 in 1988, the elected office of the California Insurance Commissioner was created in 1991. Previously, the position was held by a person appointed by the Governor. The Insurance Commissioner oversees the Department of Insurance. Democrat Dave Jones won the November 2, 2010 election for California Insurance Commissioner. The Insurance Commissioner does not oversee the majority of Health Plans and Health Insurance. HMO Health Plans and PPO Plans offered by Anthem Blue Cross and Blue Shield of California are overseen by the California Department of Managed Health Care.", "An insurance commissioner (or commissioner of insurance) is a public official in the executive branch of a state or territory in the United States who, along with his or her office, regulate the insurance industry. The powers granted to the office of an insurance commissioner differ in each state. The office of an insurance commissioner is established either by the state constitution or by statute. While most insurance commissioners are appointed, in some jurisdictions they are elected. The office of the insurance commissioner may be part of a larger regulatory agency, or an autonomous department.", "The realistic reporting method has been cited as a factor contributing to the demutualisation of Standard Life Assurance Company. In the USA, insurance companies are regulated on a state-by-state basis. However, they must not only comply with the requirements of the state in which they are incorporated, but also with the regulations of each state in which they are licensed. The National Association of Insurance Commissioners (NAIC) provides suggested guidelines which each state is free to follow or not. For example, the Insurance Information Institute, \"Life insurers are the object of the NAIC\u2019s Intestate Insurance Product Regulation Compact, launched in 2002 as a way to develop uniform standards and a central clearinghouse to provide prompt review and regulatory approval for life insurance products.\""], "em_top1": false, "em_top10": true, "f1_top1": 0, "f1_top10": 1.0, "se_pos": [[368, 400], [48, 55], [44, 56], [368, 386], [184, 191], [423, 432], [18, 43], [46, 79], [441, 450], [181, 201]], "rd_topk": 1}, "test_2089": {"question": "Where is the word Leviathan mentioned in the Bible", "answer": ["Psalms", "Isaiah", "Book of Job"], "prediction": ["the Book of Job", "Book of Job", "Job", "the Book", "Book of Job", "Psalm", "Job", "the Book of Job", "Book of Job", "chapter 41"], "score": [90.73165893554688, 90.23829650878906, 88.84571075439453, 85.9231185913086, 85.10891723632812, 85.00979614257812, 84.86122131347656, 84.78439331054688, 83.68435668945312, 83.45018768310547], "title": [["Leviathan"], ["Leviathan"], ["Leviathan"], ["Leviathan"], ["Leviathan in popular culture"], ["Leviathan"], ["Leviathan"], ["Leviathan in popular culture"], ["Lotan"], ["Antediluvian"]], "evidence": ["Leviathan (; ) is a creature with the form of a sea monster from Jewish belief, referenced in the Hebrew Bible in the Book of Job, Psalms, the Book of Isaiah, and the Book of Amos. The Leviathan of the Book of Job is a reflection of the older Canaanite \"Lotan\", a primeval monster defeated by the god Hadad. Parallels to the role of Mesopotamian Tiamat defeated by Marduk have long been drawn in comparative mythology, as have been wider comparisons to dragon and world serpent narratives such as Indra slaying Vrtra or Thor slaying J\u00f6rmungandr, but Leviathan already figures in the Hebrew Bible as a metaphor for a powerful enemy, notably Babylon (Isaiah 27:1), and some scholars have pragmatically interpreted it as referring to large aquatic creatures, such as the crocodile. The word later came to be used as a term for \"great whale\" as well as of sea monsters in general.", "Leviathan (; ) is a creature with the form of a sea monster from Jewish belief, referenced in the Hebrew Bible in the Book of Job, Psalms, the Book of Isaiah, and the Book of Amos. The Leviathan of the Book of Job is a reflection of the older Canaanite \"Lotan\", a primeval monster defeated by the god Hadad. Parallels to the role of Mesopotamian Tiamat defeated by Marduk have long been drawn in comparative mythology, as have been wider comparisons to dragon and world serpent narratives such as Indra slaying Vrtra or Thor slaying J\u00f6rmungandr, but Leviathan already figures in the Hebrew Bible as a metaphor for a powerful enemy, notably Babylon (Isaiah 27:1), and some scholars have pragmatically interpreted it as referring to large aquatic creatures, such as the crocodile. The word later came to be used as a term for \"great whale\" as well as of sea monsters in general.", "Leviathan (; ) is a creature with the form of a sea monster from Jewish belief, referenced in the Hebrew Bible in the Book of Job, Psalms, the Book of Isaiah, and the Book of Amos. The Leviathan of the Book of Job is a reflection of the older Canaanite \"Lotan\", a primeval monster defeated by the god Hadad. Parallels to the role of Mesopotamian Tiamat defeated by Marduk have long been drawn in comparative mythology, as have been wider comparisons to dragon and world serpent narratives such as Indra slaying Vrtra or Thor slaying J\u00f6rmungandr, but Leviathan already figures in the Hebrew Bible as a metaphor for a powerful enemy, notably Babylon (Isaiah 27:1), and some scholars have pragmatically interpreted it as referring to large aquatic creatures, such as the crocodile. The word later came to be used as a term for \"great whale\" as well as of sea monsters in general.", "Leviathan (; ) is a creature with the form of a sea monster from Jewish belief, referenced in the Hebrew Bible in the Book of Job, Psalms, the Book of Isaiah, and the Book of Amos. The Leviathan of the Book of Job is a reflection of the older Canaanite \"Lotan\", a primeval monster defeated by the god Hadad. Parallels to the role of Mesopotamian Tiamat defeated by Marduk have long been drawn in comparative mythology, as have been wider comparisons to dragon and world serpent narratives such as Indra slaying Vrtra or Thor slaying J\u00f6rmungandr, but Leviathan already figures in the Hebrew Bible as a metaphor for a powerful enemy, notably Babylon (Isaiah 27:1), and some scholars have pragmatically interpreted it as referring to large aquatic creatures, such as the crocodile. The word later came to be used as a term for \"great whale\" as well as of sea monsters in general.", "The Hebrew monster Leviathan found in the Book of Job has given rise to many popular incarnations. This article treats subjects with no direct connection to the Ancient Middle East or Jewish origins. \"Leviathan\" is the title of Thomas Hobbes' 1651 work on the social contract and the origins of creation of an ideal state, and his proper name for the Commonwealth. In \"Paradise Lost\", Milton uses the term Leviathan to describe the clout and power of Satan, the ruler of many kingdoms. The German poet Heinrich Heine mentions Leviathan in his \"Romanzaro\". A Rabbi tells his Catholic opponent in a debate (the \"Disputation\") that every day of the year, but one, the God of the Jews plays for an hour with the fish at the bottom of the sea. God will one day serve the flesh of Leviathan to his chosen people. The poem gives the recipe that God will use to cook the giant fish. It will be served with garlic, raisins and rettich.", "The Leviathan is mentioned six times in the Tanakh, in , , , , and . The mention of the Tannins in the Genesis creation narrative (translated as \"great whales\" in the King James Version) and Leviathan in the Psalm do not describe them as harmful but as ocean creatures who are part of God's creation. The element of competition between God and the sea monster and the use of Leviathan to describe the powerful enemies of Israel may reflect the influence of the Mesopotamian and Canaanite legends or the contest in Egyptian mythology between the Apep snake and the sun god Ra. Alternatively, the removal of such competition may have reflected an attempt to naturalize Leviathan in a process that demoted it from deity to demon to monster.", "Leviathan (; ) is a creature with the form of a sea monster from Jewish belief, referenced in the Hebrew Bible in the Book of Job, Psalms, the Book of Isaiah, and the Book of Amos. The Leviathan of the Book of Job is a reflection of the older Canaanite \"Lotan\", a primeval monster defeated by the god Hadad. Parallels to the role of Mesopotamian Tiamat defeated by Marduk have long been drawn in comparative mythology, as have been wider comparisons to dragon and world serpent narratives such as Indra slaying Vrtra or Thor slaying J\u00f6rmungandr, but Leviathan already figures in the Hebrew Bible as a metaphor for a powerful enemy, notably Babylon (Isaiah 27:1), and some scholars have pragmatically interpreted it as referring to large aquatic creatures, such as the crocodile. The word later came to be used as a term for \"great whale\" as well as of sea monsters in general.", "The Hebrew monster Leviathan found in the Book of Job has given rise to many popular incarnations. This article treats subjects with no direct connection to the Ancient Middle East or Jewish origins. \"Leviathan\" is the title of Thomas Hobbes' 1651 work on the social contract and the origins of creation of an ideal state, and his proper name for the Commonwealth. In \"Paradise Lost\", Milton uses the term Leviathan to describe the clout and power of Satan, the ruler of many kingdoms. The German poet Heinrich Heine mentions Leviathan in his \"Romanzaro\". A Rabbi tells his Catholic opponent in a debate (the \"Disputation\") that every day of the year, but one, the God of the Jews plays for an hour with the fish at the bottom of the sea. God will one day serve the flesh of Leviathan to his chosen people. The poem gives the recipe that God will use to cook the giant fish. It will be served with garlic, raisins and rettich.", "Lotan (Ugaritic: \ud800\udf8d\ud800\udf9a\ud800\udf90\"-ltn\", transliterated \"L\u00f4t\u0101n\", \"Litan\", or \"Lit\u0101nu\", meaning \"coiled\") is a servant of the sea god Yam defeated by the storm god Hadad-Ba\u02bfal in the Ugaritic \"Baal Cycle\". possibly with the help or by the hand of his sister \u02bfAnat. Lotan seems to have been prefigured by the serpent \"T\u00eamtum\" represented in Syrian seals of the 18th\u201316th century BC, and finds a later reflex in the sea monster \"Leviathan\", whose defeat at the hands of Yahweh is alluded to in the biblical Book of Job and in Isaiah 27:1.", "A modern naturalistic view of the ancient world, along with the abandonment of the term \"Antediluvian\", came about with the works of Darwin and Agassiz in the 1860s. From antiquity, fossils of large animals were often quoted as having lived together with the giants from the Book of Genesis: e.g. the Tannin or \"great sea monsters\" of Gen. 1:21. They are often described in later books of the Bible, especially by God himself in the Book of Job: e.g. Re'em in verse 39:9, Behemoth in chapter 40 and Leviathan in chapter 41. With the advent of geological mapping in the early 19th century, it became increasingly obvious that much of the fossils associated with the \"secondary\" (sedimentary) rock, notably large animals like Ichthyosaurs, Mosasaurs, Pliosaurs and the various giant mammals found when excavating the Catacombs of Paris, were neither those of giant humans nor of any extant animals. The geologists of the day increasingly came to use the term \"Antediluvian\" only for the younger strata containing fossils of animals resembling those alive today."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[114, 129], [118, 129], [126, 129], [114, 122], [42, 53], [208, 213], [210, 213], [38, 53], [491, 502], [512, 522]], "rd_topk": 5}, "test_2090": {"question": "What was the date of the signing of the Declaration of independence", "answer": ["August 2 , 1776"], "prediction": ["August 2, 1776", "August 2, 1776", "July 4, 1776", "August 2, 1776", "July 4, 1776", "July 4, 1776", "July 4, 1776", "July 4, 1776", "August 2, 1776", "August 2, 1776"], "score": [93.8621826171875, 91.94602966308594, 89.57441711425781, 89.32496643066406, 87.7047119140625, 87.62804412841797, 87.46389770507812, 87.26219177246094, 86.80197143554688, 86.68260192871094], "title": [["Signing of the United States Declaration of Independence"], ["Signing of the United States Declaration of Independence"], ["United States Declaration of Independence"], ["1776 (film)"], ["United States Declaration of Independence"], ["Province of Massachusetts Bay"], ["Signing of the United States Declaration of Independence"], ["United States Declaration of Independence"], ["1776 (musical)"], ["United States Declaration of Independence"]], "evidence": ["The signing of the United States Declaration of Independence occurred primarily on August 2, 1776 at the Pennsylvania State House, Independence Hall in Philadelphia, Pennsylvania. The 56 delegates to the Second Continental Congress represented the 13 former colonies which had declared themselves the \"United States of America,\" and they endorsed the Declaration of Independence which the Congress had approved on July 4, 1776. The Declaration proclaimed that the former Thirteen Colonies then at war with Great Britain were now a sovereign, independent nation and thus no longer a part of the British Empire. The signers\u2019 names are grouped by state, with the exception of President of the Continental Congress John Hancock; the states are arranged geographically from north to south.", "The final draft of the Declaration was approved by the Continental Congress on July 4, although the date of its signing has long been disputed. Most historians have concluded that it was signed on August 2, 1776, nearly a month after its adoption, and not on July 4 as is commonly believed. The Second Continental Congress adopted the Declaration of Independence on July 4, 1776, with 12 of the 13 colonies voting in favor and New York abstaining. The date that the Declaration was signed has long been the subject of debate. Thomas Jefferson, Benjamin Franklin, and John Adams all wrote that it was signed by Congress on the day when it was adopted on July 4, 1776. That assertion is seemingly confirmed by the signed copy of the Declaration, which is dated July 4. Additional support for the July 4 date is provided by the \"Journals of Congress\", the official public record of the Continental Congress. The proceedings for 1776 were first published in 1777, and the entry for July 4 states that the Declaration was engrossed and signed on that date (the official copy was handwritten).", "The Declaration became official when Congress voted for it on July 4; signatures of the delegates were not needed to make it official. The handwritten copy of the Declaration of Independence that was signed by Congress is dated July 4, 1776. The signatures of fifty-six delegates are affixed; however, the exact date when each person signed it has long been the subject of debate. Jefferson, Franklin, and Adams all wrote that the Declaration had been signed by Congress on July 4. But in 1796, signer Thomas McKean disputed that the Declaration had been signed on July 4, pointing out that some signers were not then present, including several who were not even elected to Congress until after that date.", "Another departure from history is that the separation from Great Britain was accomplished in two steps: the actual vote for independence came on July 2 with the approval of Lee's resolution of independence. The wording of the Declaration of Independence\u2014the statement to the world as to the reasons necessitating the split\u2014was then debated for three days before being approved on July 4. The vote for independence did not hinge on some passages being removed from the Declaration, as implied in the film (and the play), since Congress had already voted in favor of independence before debating the Declaration. For the sake of drama, the play's authors combined the two events. In addition, some historians believe that the Declaration was not signed on July 4, as shown in \"1776\", but was instead signed on August 2, 1776. Others point out that the final, official copy of the document was signed by the delegates not on a single date, but over several weeks and months, commencing in July but not being completed until as late as September. The authors of \"1776\" had the delegates sign the Declaration on July 4 for dramatic reasons.", "The United States Declaration of Independence is the statement adopted by the Second Continental Congress meeting at the Pennsylvania State House (now known as Independence Hall) in Philadelphia, Pennsylvania on July 4, 1776. The Declaration announced that the Thirteen Colonies at war with the Kingdom of Great Britain would regard themselves as thirteen independent sovereign states, no longer under British rule. With the Declaration, these new states took a collective first step toward forming the United States of America. The declaration was signed by representatives from New Hampshire, Massachusetts Bay, Rhode Island, Connecticut, New York, New Jersey, Pennsylvania, Maryland, Delaware, Virginia, North Carolina, South Carolina, and Georgia.", "On May 1, 1776, the General Assembly adopted a resolution declaring independence in the name of \"The Government and People of the Massachusetts Bay in New England\". This was followed by the United States Declaration of Independence on July 4, 1776, declaring the independence of all of the Thirteen Colonies. The Constitution of the Commonwealth of Massachusetts was agreed upon in Cambridge in October 1779 and adopted by the delegates nine months later in June 1780, to go into effect \"the last Wednesday of October next\". In elections held in October 1780, John Hancock was elected the first Governor of Massachusetts along with representatives to the commonwealth's first General Court.", "The final draft of the Declaration was approved by the Continental Congress on July 4, although the date of its signing has long been disputed. Most historians have concluded that it was signed on August 2, 1776, nearly a month after its adoption, and not on July 4 as is commonly believed. The Second Continental Congress adopted the Declaration of Independence on July 4, 1776, with 12 of the 13 colonies voting in favor and New York abstaining. The date that the Declaration was signed has long been the subject of debate. Thomas Jefferson, Benjamin Franklin, and John Adams all wrote that it was signed by Congress on the day when it was adopted on July 4, 1776. That assertion is seemingly confirmed by the signed copy of the Declaration, which is dated July 4. Additional support for the July 4 date is provided by the \"Journals of Congress\", the official public record of the Continental Congress. The proceedings for 1776 were first published in 1777, and the entry for July 4 states that the Declaration was engrossed and signed on that date (the official copy was handwritten).", "The Declaration was transposed on paper, adopted by the Continental Congress, and signed by John Hancock, President of the Congress, on July 4, 1776, according to the 1911 record of events by the U.S. State Department under Secretary Philander C. Knox. On August 2, 1776, a parchment paper copy of the Declaration was signed by 56 persons. Many of these signers were not present when the original Declaration was adopted on July 4. Signer Matthew Thornton from New Hampshire was seated in the Continental Congress in November; he asked for and received the privilege of adding his signature at that time, and signed on November 4, 1776.", "The central departure from history is that the separation from Great Britain was accomplished in two steps: the actual vote for independence came on July 2 with the approval of Lee's resolution of independence. The wording of the Declaration of Independence\u2014the statement to the world as to the reasons necessitating the split\u2014was then debated for three days before being approved on July 4. The vote for independence did not hinge on some passages being removed from the Declaration, as implied in the play, since Congress had already voted in favor of independence before debating the Declaration. For the sake of drama, the play's authors combined the two events. In addition, some historians believe that the Declaration was not signed on July 4, as shown in \"1776\", but was instead signed on August 2, 1776. The authors of \"1776\" had the delegates sign the Declaration on July 4 for dramatic reasons.", "Historians have generally accepted McKean's version of events, arguing that the famous signed version of the Declaration was created after July 19, and was not signed by Congress until August 2, 1776. In 1986, legal historian Wilfred Ritz argued that historians had misunderstood the primary documents and given too much credence to McKean, who had not been present in Congress on July 4. According to Ritz, about thirty-four delegates signed the Declaration on July 4, and the others signed on or after August 2. Historians who reject a July 4 signing maintain that most delegates signed on August 2, and that those eventual signers who were not present added their names later."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[83, 97], [197, 211], [228, 240], [808, 822], [212, 224], [235, 247], [366, 378], [136, 148], [797, 811], [185, 199]], "rd_topk": 5}, "test_2091": {"question": "Who is considered to be the greatest English composer of the Baroque period", "answer": ["Henry Purcell"], "prediction": ["Henry Purcell", "George Frideric Handel,", "George Frideric Handel", "George Frideric Handel", "Henry Purcell", "Christopher Wren", "George Frideric Handel,", "George Frideric Handel,", "Rubens.", "J.S. Bach"], "score": [93.4605941772461, 92.83599853515625, 92.27356719970703, 90.57025146484375, 88.61940002441406, 87.60792541503906, 86.80314636230469, 86.74017333984375, 86.63888549804688, 86.23908233642578], "title": [["Music in the Elizabethan era"], ["Baroque music of the British Isles"], ["Classical music of the United Kingdom"], ["Baroque music of the British Isles"], ["England"], ["Architecture of the United Kingdom"], ["Messiah (Handel)"], ["Music of the United Kingdom"], ["Flemish painting"], ["Medieval music"]], "evidence": ["In music history, the music of the English Renaissance is noted for its complex polyphonic vocal music, both sacred and secular, and the emergence of instrumental music. With the gradual shift in the early baroque period, England experienced a decline in musical standing among European nations. After Dowland, the greatest English composer was Henry Purcell whose death left a void in English music history until the Victorian era. The Church was a major influence for music in the 16th century. The Puritans wanted to do away with all Church music, but the will of the people to sing only made it more predominant. Many composers that wrote for the church also wrote for the royalty. The style of the church music was known as choral polyphony. Hundreds of hymns were written for the church. Many of those are still sung today. It is \u201cdoubtless (that) your worship requires music.\u201d At the most elegant of weddings, usually those of the nobility, the processional included musicians who played lutes, flutes, and violins. It was very common of that time for commoners to have music played for them whenever they wanted, too.", "Baroque music of the British Isles bridged the gap between the early music of the Medieval and Renaissance periods and the development of fully fledged and formalised orchestral classical music in the second half of the eighteenth century. It was characterised by more elaborate musical ornamentation, changes in musical notation, new instrumental playing techniques and the rise of new genres such as opera. Although the term Baroque is conventionally used for European music from about 1600, its full effects were not felt in Britain until after 1660, delayed by native trends and developments in music, religious and cultural differences from many European countries and the disruption to court music caused by the Wars of the Three Kingdoms and Interregnum. Under the restored Stuart monarchy the court became once again a centre of musical patronage, but royal interest in music tended to be less significant as the seventeenth century progressed, to be revived again under the House of Hanover. The Baroque era in British music can be seen as one of an interaction of national and international trends, sometimes absorbing continental fashions and practices and sometimes attempting, as in the creation of ballad opera, to produce an indigenous tradition. However, arguably the most significant British composer of the era, George Frideric Handel, was a naturalised German, who helped integrate British and continental music and define the future of the classical music of the United Kingdom that would be officially formed in 1801.", "Music in the British Isles, from the earliest recorded times until the Baroque and the rise of recognisably modern classical music, was a diverse and rich culture, including sacred and secular music and ranging from the popular to the elite. Each of the major nations of England, Ireland, Scotland and Wales retained unique forms of music and of instrumentation, but British music was highly influenced by continental developments, while British composers made an important contribution to many of the major movements in early music in Europe, including the polyphony of the Ars Nova and laid some of the foundations of later national and international classical music. Musicians from the British Isles also developed some distinctive forms of music, including Celtic chant, the Contenance Angloise, the rota, polyphonic votive antiphons and the carol in the medieval era and English madrigals, lute ayres and masques in the Renaissance era, which led particularly to English language opera developed in the early Baroque period. The dominant figure in classical music in the later baroque era, and beyond, was the German-born George Frideric Handel (1685\u20131759).", "The leading figure in British music of the early 18th century was a naturalized Briton, George Frideric Handel (1685\u20131759). Although he was born in Germany, he first visited England in 1710, later moving there and becoming a naturalised citizen, playing a defining role in the music of the British Isles. Handel drew heavily on the continental, particularly Italian, Baroque style, but was also highly influenced by English composers such as Purcell. He was a prolific composer, producing major orchestral works such as the \"Water Music\", and the \"Music for the Royal Fireworks\". His opera, including \"Rinaldo\" (1711, 1731), \"Orlando\" (1733), \"Ariodante\" (1735), \"Alcina\" (1735) and \"Serse\" (1738, also known as \"Xerxes\"), helped make Britain second only to Italy as a centre of operatic production. His sacred drama and choral music, particularly the coronation anthem \"Zadok the Priest\" (written for the inauguration of George II in 1727) which has remained part of the ceremony for British monarchs, and above all, the \"Messiah\", helped set the British taste in music for the next 200 years. He was a major influence on future classical composers including Haydn, Mozart and Beethoven.", "Early English composers in classical music include Renaissance artists Thomas Tallis and William Byrd, followed up by Henry Purcell from the Baroque period. German-born George Frideric Handel became a British subject and spent most of his composing life in London, creating some of the most well-known works of classical music, \"The Messiah\", \"Water Music\", and \"Music for the Royal Fireworks\". One of his four Coronation Anthems, \"Zadok the Priest\", composed for the coronation of George II, has been performed at every subsequent British coronation, traditionally during the sovereign's anointing. There was a revival in the profile of composers from England in the 20th century led by Edward Elgar, Benjamin Britten, Frederick Delius, Gustav Holst, Ralph Vaughan Williams and others. Present-day composers from England include Michael Nyman, best known for \"The Piano\", and Andrew Lloyd Webber, whose musicals have achieved enormous success in the West End and worldwide.", "Throughout the Plantagenet era an English Gothic architecture flourished\u2014the medieval cathedrals such as Canterbury Cathedral, Westminster Abbey and York Minster are prime examples. Expanding on the Norman base there was also castles, palaces, great houses, universities and parish churches. Medieval architecture was completed with the 16th century Tudor style; the four-centred arch, now known as the Tudor arch, was a defining feature as were wattle and daub houses domestically. In the aftermath of the Renaissance, the English Baroque style appeared, which architect Christopher Wren particularly championed. English Baroque is a casual term, sometimes used to refer to the developments in English architecture that were parallel to the evolution of Baroque architecture in continental Europe between the Great Fire of London (1666) and the Treaty of Utrecht (1713). Queen Anne Style architecture flourished in England from about 1660 to about 1720, even though the Queen's reign covered only the period 1702\u20131714. Buildings in the Queen Anne style are strongly influenced by Dutch domestic architecture: typically, they are simple rectilinear designs in red brick, with an undemonstrative charm. Georgian architecture followed in a more refined style, evoking a simple Palladian form; the Royal Crescent at Bath is one of the best examples of this. With the emergence of romanticism during Victorian period, a Gothic Revival was launched\u2014in addition to this around the same time the Industrial Revolution paved the way for buildings such as The Crystal Palace. Since the 1930s various modernist forms have appeared whose reception is often controversial, though traditionalist resistance movements continue with support in influential places.", "The composer George Frideric Handel, born in Halle, Germany in 1685, took up permanent residence in London in 1712, and became a naturalised British subject in 1727. By 1741 his pre-eminence in British music was evident from the honours he had accumulated, including a pension from the court of King George II, the office of Composer of Musick for the Chapel Royal, and\u2014most unusually for a living person\u2014a statue erected in his honour in Vauxhall Gardens. Within a large and varied musical output, Handel was a vigorous champion of Italian opera, which he had introduced to London in 1711 with \"Rinaldo\". He subsequently wrote and presented more than 40 such operas in London's theatres.", "British chamber and orchestral music drew inspiration from continental Europe as it developed into modern classical music. The Baroque era in British music can be seen as one of an interaction of national and international trends, sometimes absorbing continental fashions and practices and sometimes attempting, as in the creation of ballad opera, to produce an indigenous tradition. However, arguably the most significant British composer of the era, George Frideric Handel, was a naturalised German, who helped integrate British and continental music and define the future of the classical music of the United Kingdom that would be officially formed in 1801.", "Flemish painting flourished from the early 15th century until the 17th century, gradually becoming distinct from the painting of the rest of the Low Countries, especially the modern Netherlands. In the early period, up to about 1520, the painting of the whole area is (especially in the Anglophone world) typically considered as a whole, as Early Netherlandish painting. This was dominated by the Flemish south, but painters from the north were also important. Dutch and Flemish Renaissance painting, of which Antwerp became the centre, covers the period up to about 1580 or later, by the end of which the north and south Netherlands had become politically separated. Flemish Baroque painting was especially important in the first half of the 17th century, dominated by Rubens.", "This era begins with the fall of the Western Roman Empire in the fifth century and ends sometime in the early fifteenth century. Establishing the end of the medieval era and the beginning of the Renaissance music era is difficult, since the trends started at different times in different regions. The date range in this article is the one usually adopted by musicologists. During the Medieval period the foundation was laid for the music notation and music theory practices that would shape Western music into the norms that developed during the common-practice era, a period of shared music writing practices which encompassed the Baroque music composers from 1600\u20131750, such as J.S. Bach and Classical music period composers from the 1700s such as W.A. Mozart and Romantic music era composers from the 1800s such as Wagner. The most obvious of these is the development of a comprehensive music notational system which enabled composers to write out their song melodies and instrumental pieces on parchment or paper. Prior to the development of musical notation, songs and pieces had to be learned \"by ear\", from one person who knew a song to another person. This greatly limited how many people could be taught new music and how wide music could spread to other regions or countries. The development of music notation made it easier to disseminate (spread) songs and musical pieces to a larger number of people and to a wider geographic area. However the theoretical advances, particularly in regard to rhythm\u2014the timing of notes\u2014and polyphony\u2014using multiple, interweaving melodies at the same time\u2014are equally important to the development of Western music."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[345, 358], [1330, 1353], [1127, 1149], [88, 110], [118, 131], [572, 588], [13, 36], [452, 475], [770, 777], [680, 689]], "rd_topk": 2}, "test_2092": {"question": "Who plays Nathan'S mother on general hospital", "answer": ["Donna Mills"], "prediction": ["Donna Mills", "Michelle Fairley", "Donna Mills", "Kim Thomson", "Kristina Wagner).", "Kathleen Gati", "Natasha Lee", "Denise Galik).", "Obrecht", "Deb"], "score": [96.94023132324219, 94.97915649414062, 93.89978790283203, 92.0145263671875, 91.74125671386719, 91.43887329101562, 90.36800384521484, 90.16603088378906, 89.90620422363281, 89.68013000488281], "title": [["Nathan West (General Hospital)"], ["Nathan Young"], ["Nathan West (General Hospital)"], ["Nathan Wylde"], ["Nathan West (General Hospital)"], ["General Hospital characters (2010s)"], ["Rachel Armstrong"], ["List of General Hospital characters (1990s)"], ["Nathan West (General Hospital)"], ["Nathan Scott"]], "evidence": ["Not attaching Nathan to a specific love interest immediately allows for the writers to slowly integrate him into the canvas. \"Soaps In Depth\" reported that Nathan's isn't just some \"run-of-the-mill\" cop, but \"he's on a mission to stir things up for a few people!\" It is soon revealed that Nathan is in town investigating his estranged brother-in-law Silas Clay (Michael Easton) in the attempted murder of his comatose sister Nina. However, Silas's former mistress Ava Jerome (Maura West) is also at the top of the suspect list. In 2014, legendary actress Donna Mills, known for her portrayal of Abby Cunningham on the prime time soap, \"Knots Landing\" was cast in the role of Madeline Reeves\u2014Nathan's mother. It is revealed that Madeline raised Nathan to believe Silas was guilty and he is working on her behalf to lock Silas up for Nina's condition. Despite acting to avenge his sister, Nathan tolerates Madeline's disdain for his career choice because she thinks it is \"below them.\" Nathan partners up with Silas and his girlfriend Sam Morgan (Kelly Monaco) to set a trap for Ava believing she is guilty. However, the sting operation doesn't go as planned when Madeline is revealed to be the culprit\u2014and Nathan is forced to arrest her.", "Nathan steals some pick 'n' mix from a bowling alley and continues to aggravate the situation. He causes a disruption and when the manager threatens to phone the police he tells him to do so before stapling him in the hand. Nathan is given community service for this disruption. While on his first day of community service, Nathan is caught in a storm. He appears unaffected, unlike those he is doing community service with. Nathan's mother, Louise (Michelle Fairley), kicks him out of his house for his behaviour towards his step-father, Jeremy (Jo Stone-Fewings). Nathan begins living in the community centre. The group kill Tony (Danny Sapani/Louis Decosta Johnson), as an act of self-defense, and bury him. Nathan sleeps with Ruth (Amy Beth Hayes/Clare Welch) who he discovers has been affected by the storm and is really 82 years old. In an alternate timeline, the group are killed because Curtis Donovan (Nathan Stewart-Jarrett) used his power of time travel to change the events, preventing him from ending up in community service; Nathan, however, survives and is told that when found by paramedics he was almost dead. Rachel (Jessica Brown Findlay) begins manipulating people into behaving how she wants through her power of suggestion. Nathan kidnaps Rachel using a gun and takes her to the roof of the community centre. She can't or won't revert those back to their original state and she realises Nathan's gun is only a water pistol. She and Nathan brawl before both falling to their deaths. After Nathan's funeral he wakes up in his coffin, realising he is immortal.", "Detective Nathan West arrives in Port Charles, and meets Maxie Jones (Kirsten Storms) when he sublets her apartment. Maxie leaves on a vacation, while Nathan settles in Port Charles. He starts investigating Dr. Silas Clay (Michael Easton) in regards to the overdose of Silas' wife, Nina Reeves (Michelle Stafford), suspecting Silas is responsible. It's later revealed that Nathan is actually Nina's brother. Nathan's mother Madeline Reeves (Donna Mills) claims that Nina has died after Silas has relinquished his rights to Nina's vast estate. Nathan is shocked when Madeline falls into the trap to catch the killer, and confesses that she drugged Nina to kill her unborn child. He arrests Madeline, and simultaneously reveals his identity. Maxie returns with her new manipulative boyfriend Levi Dunkleman (Zachary Garred), who Nathan immediately clashes with.", "Nathan befriends Ryan Lamb (James Sutton). He is not pleased when Ryan and Katie start dating but is more distressed with his father's \"affair\" with Ryan's mother Faye (Kim Thomson). He goes to London for a while to clear his head. Returning his attentions to Leyla in October, Nathan separates her and David by using his parents' contacts to get David more work. Leyla doesn't help when she borrows money from the petty cash in the farm shop's till and is caught when Nathan collects it early. He sees money missing but conceals it when Leyla confesses and starts charming her, taking her to exclusive parties. They sleep together but Leyla feels guilty so Nathan blackmails her to take responsibility for him crashing a car whilst drunk. Struggling with her conscience, Leyla tells David that she slept with Nathan and he splits up with her but he hits Nathan for bullying her. Nathan's mother Natasha realises that something is wrong and asks Katie, who tells her David hit Nathan but Nathan twists it so that Leyla gets the blame. Angry at Nathan's manipulation, she visits him and tells him she won't quit her job and knees him in the groin. After this, Nathan leaves Leyla alone.", "Nathan meets Britt Westbourne (Kelly Thiebaud) at the same time that it's revealed Nathan is the biological son of Liesl Obrecht (Kathleen Gati), Madeline's sister, and Britt is actually his sister. Madeline confesses to Nathan when he mentions almost sleeping with Britt. Nathan is shocked when Madeline reveals Nina is alive as she is carted off to prison. Maxie is trying to regain custody of her daughter Georgie, but is discouraged about going to her hearing. Nathan encourages Maxie to fight for Georgie, then covers for her, lying that he threw her summons away by mistake. When the judge discovers Nathan lied for Maxie and she loses custody of her daughter, Nathan suspects Levi tipped off the judge, and tries to prove it. Meanwhile, Nathan is reunited with Nina, who arrives in Port Charles. Levi later frames Nathan for tipping off immigration about Levi's expired visa, leading to Maxie throwing Nathan out of the apartment. As Maxie is set to marry Levi, Nathan discovers Levi has stolen a family heirloom from Maxie's mother Felicia Scorpio (Kristina Wagner). With the help of his partner Dante Falconeri (Dominic Zamprogna), Nathan crashes the wedding, only for Levi to escape with Maxie and Dante's wife, Lulu (Emme Rylan), at gunpoint. Nathan tracks down Maxie, but is kidnapped by Victor Cassadine (Thaao Penghlis). Nathan is about to kill Victor until Obrecht says that they are father and son. Nathan rescues Maxie, and the two end up killing Levi and his father, Peter Harrell (David Gautreaux). As they escape, it was revealed that Victor isn't Nathan's father, and Obrecht kills Victor to keep Nathan from finding out.", "Claudette Beaulieu, portrayed by Bree Williamson, first appeared on July 5, 2016. She is the ex-wife of Nathan West (Ryan Paevey). The announcement of Williamson's casting was on May 26, 2016. According to reports, Williamson wrapped her stint on October 24. Williamson made an appearance on October 27, 2017. Nathan gets shot in February 2016 and, after his surgery, still under the influence of drugs, he refers to Maxie Jones (Kirsten Storms) as Claudette. Nathan later reveals he was married to Claudette to help her stay in the country and she broke his heart. Nathan and Maxie become engaged, and his mother, Liesl Obrecht (Kathleen Gati) advises him to keep quiet about Claudette, fearing he could end up in prison. Nathan later confesses that he found Claudette in bed with another man and shot him in a drunken rage. Maxie forgives him, understanding why he felt the need to keep quiet. In July 2016, Claudette comes to town, inquiring about a job at \"Crimson Magazine\", Maxie's workplace. She hides the fact that she knows Maxie is engaged to Nathan. Later, she lures Nathan to her hotel room, hoping to talk to him. Maxie, at the same time, finds out who Claudette is, and the two leave. Though Claudette says she's not after Nathan, Maxie is suspicious of her. Claudette reunites with Griffin Munro (Matt Cohen), the man who she cheated on Nathan with. Griffin is not happy, though, and says he's ashamed of their affair. Claudette says that she still loves him, and hopes they'll be together. Claudette confesses to Nathan that she came to Port Charles looking for him because she wants his help to protect her and her daughter from her ex-lover, Valentin Cassadine (James Patrick Stuart). She and her daughter, Charlotte, lived with Valentin, until he became dangerous and threatened her. She took Charlotte and went on the run. Claudette claims Charlotte is Nathan's daughter, but when a DNA test disproves it, she says Griffin is the father. After bringing Charlotte to town, Claudette finds her room ransacked, and realizes Valentin has found her. She skips town, leaving Charlotte behind with Griffin. On the plane, though, she's cornered by Valentin. Nathan finds out he and Claudette are not divorced, and he & Maxie try to track her down so they can get married. A cop tells them that Claudette committed suicide. However, the cop was later revealed to be working for Valentin, and Claudette's whereabouts are unknown.", "Kim and Rachel marry and try to adopt a baby called Joe Morton until his mother Lee (Natasha Lee) returns to take him off the pair. Kit reveals she is pregnant and when she has the baby Kim takes Kit's side on many things. Hugh Sullivan (Rodger Corser), Rachel's ex-boyfriend turns up, they sleep together. Hugh leaves Rachel alone after she refuses to leave Kim, she tells Kim the truth and he refuses to forgive her and tells her he is going to live with Kit because he loves her instead. Brad's friend Henk Van Patten (Damian de Montemas) arrives in town and starts a relationship with Cassie Turner (Sharni Vinson), leaving Rachel furious and reveals he sexually assaulted her when she was younger. A stalker becomes active targeting the hospital. Rachel starts a relationship with Lewis and becomes pregnant. He wants nothing to do with her, Rachel miscarries and Lewis decides he wants the baby after all. Sam Holden (Jessica Chapnik) accuses Lewis of being the hospital stalker, Reverend Hall offers Rachel a lift home and she gladly accepts. He reveals he is the stalker and ties her up, gagging her. He tries to hurt her but collapses and has a fit, Rachel saves his life.", "The role was originated on General Hospital in 1992, as portrayed by Cari Shayne, who left the series in 1994. In June 1997, the character returned as part of the cast of spin-off series, Port Charles, as portrayed by Jennifer Hammon. Hammon left the series on June 24, 1999, and was replaced by Marie Wilson, who portrayed the role from June 30, 1999, to July 1, 2003. Karen was raised by an alcoholic mother, Rhonda Wexler (Denise Galik). During high school, she was involved with Jason Quartermaine (then Steve Burton), but she soon met Jagger Cates (Antonio Sab\u00e0to, Jr.). Brenda Barrett (Vanessa Marcil) also wanted Jagger, and she schemed to keep Jagger and Karen apart. Eventually, Jagger and Karen were involved only for her remember that she was molested by her mothers boyfriend, Ray Conway (Stephen Burleigh). As time went by, she began going to seedy places, where she met Stone (Michael Sutton), Jagger's long lost brother. Stone introduced her to Sonny Corinthos (Maurice Benard). Karen began stripping in Sonny's club, the Paradise Lounge. She also got hooked on pills at this time, since she was participating in a summer program at GH for future doctors' During this time she had a brief affair with Sonny. Jagger and Karen split up. Alan Quartermaine (Stuart Damon) caught her stealing drugs. She confessed the abuse to Gail Baldwin (Susan Brown (American actress)). She and Jagger got back together, and they got married when he got accepted into the police academy in Chicago. Alan offers to pay Karen's expenses through medical school. They came back for brief visit when Stone was dying. Sometime after that they moved to San Francisco where Jagger became an undercover cop.", "Despite the recent revelations about Nathan's other familial connections, in May 2014 Paevey himself wondered if Nathan's paternity would be addressed. With the reveal that Obrecht is his mother, \"On-Air On-Soaps\" immediately speculated that Cesar Faison (Anders Hove) who had recently been revealed as his sister Britt's father could be Nathan's father too. However, Carol Baroom from \"SoapHub\" said the Faison theory \"doesn't make sense\" because there would have been no reason for Obrecht to give Nathan up\u2014she would have raised him with Faison and Britt. Faison as Nathan's father would also contradict Obrecht's prior disappointment with being unable to give him a male heir. Baroom also suggested that Obrecht feels it would hurt Faison to know she had another man's child. In December 2014, it is made clear that Faison would have never accepted another man's child.", "Lafferty has revealed that his favorite episode was \"4 Years, 6 Months, 2 Days.\" He said, \"When we came back four years later in the characters' lives and Nathan and Haley had Jamie, it was an exciting atmosphere not really knowing where my character would go. He was in such a dark place and not knowing how the family unit was going to stay together, and then also being able to work with Jackson for the first time \u2014 I'll always have fond memories of that.\" In season one, Nathan was introduced as the selfish, jock basketball player for the Tree Hill Ravens. He dated Peyton Sawyer for a significant amount of time, though their relationship is complicated. After his half-brother, Lucas Scott, joins the school basketball team, Nathan feels threatened and goes out of his way to often tease and ridicule him, most often by pointing out how Dan favored him instead of Lucas. Nathan deals with constant pressure to be the best from his father, Dan Scott, who is determined to further Nathan's career. His mother, Deb, was never around in the beginning but tried her best to be there for him when she realized how much pressure he received from Dan. Peyton breaks up with Nathan after she sees the kind of person he is."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[555, 566], [450, 466], [441, 452], [169, 180], [1057, 1074], [630, 643], [85, 96], [426, 440], [173, 180], [1016, 1019]], "rd_topk": 2}, "test_2093": {"question": "Where did the tradition of the pinata come from", "answer": ["treats"], "prediction": ["Tahitian origin,", "Dominican Republic", "Dominican Republic", "the Dominican Republic", "Sundanese tradition", "Dominican Republic", "the Dominican Republic", "ancient Greece", "Indian classical music", "the Dominican Republic in the Caribbean"], "score": [81.45040130615234, 80.50965881347656, 80.49264526367188, 80.48148345947266, 80.22830200195312, 79.96636962890625, 79.91145324707031, 79.83920288085938, 79.7928695678711, 79.74951934814453], "title": [["Pate (instrument)"], ["Bachata (dance)"], ["Bachata (music)"], ["Bachata (dance)"], ["Pakuan Pajajaran"], ["Traditional Bachata"], ["Bachata (music)"], ["Pinax"], ["Tala (music)"], ["Bachata (dance)"]], "evidence": ["The P\u0101t\u0113 is a Samoan percussion instrument of Tahitian origin, named after the Samoan word for \"beat\" or \"clap\" \"pulse\". It is one of many Samoan log drum variants and is of the slit drum family, and therefore is also of the idiophone percussion family. It is made from a hollowed-out log, usually of Miro wood and produces a distinctive and loud sound. Different sizes of log drums offer different pitches and volumes, as well as striking the log drum in the middle or near the ends. Samoa had large Indigenous log wood Talipalau drums a variant a little larger than a pate drum and somewhat smaller than the Lali log drum variant. The dimensions of some Talipalau are large as 1.5 metres high and 3 metres in length, these Talipalau are a distant cousin to the Fijian Lali drum which were larger in size. The smaller pate was said to be introduced to Samoa by inter-married Tahitians whom visited and settled in Samoa some 500 yrs ago, in recent times however the pate is used together with the other lesser known traditional log drum variants as well as the Samoan fala as percussive musical instruments. Because of the widespread distribution of Samoan music through the great Polynesian expansion, the use of the P\u0101t\u0113 has gained much popularity among other neighbouring Polynesian Islands such as Uvea & Futuna, Tokelau, Tuvalu and Niue.", "Bachata is a style of social dance from the Dominican Republic which is now danced all over the world. It is associated with bachata music. In partnering, the lead can decide whether to perform in open, semi-closed or closed position. Dance moves or step variety strongly depend on the music (such as the rhythms played by the different instruments), setting, mood, and interpretation. Unlike salsa, bachata dance does not usually include many turn patterns. In the West, various dancers are known to copy moves and turn patterns from various couple dances, performing these combinations in the timing used in bachata dancing, thus creating a fusion dance.", "The earliest bachata originated in the countryside in Dominican Republic in the first half of the 20th century. Jose Manuel Calderon recorded the first Bachata song, \"Borracho de amor\" in 1962. The genre mixed the pan-Latin American style called bolero with more African elements coming from Son, and the troubadour singing tradition common in Latin America. During much of its history, Bachata music was disregarded by Dominican elite and associated with rural underdevelopment and crime. As recently as the 1980s, bachata was considered too vulgar, crude and musically rustic to be broadcast on television or radio in the Dominican Republic. In the 1990s, however, bachata's instrumentation changed from nylon string Spanish guitar and maracas of Traditional Bachata to the electric steel string and guira of Modern Bachata. Bachata further transformed in the 21st century with the creation of Urban Bachata styles by bands such as Monchy y Alexandra and Aventura. These new modern styles of bachata become an international phenomenon, and today bachata is one of the most popular styles of Latin music.", "Bachata is a style of social dance from the Dominican Republic which is now danced all over the world. It is associated with bachata music. In partnering, the lead can decide whether to perform in open, semi-closed or closed position. Dance moves or step variety strongly depend on the music (such as the rhythms played by the different instruments), setting, mood, and interpretation. Unlike salsa, bachata dance does not usually include many turn patterns. In the West, various dancers are known to copy moves and turn patterns from various couple dances, performing these combinations in the timing used in bachata dancing, thus creating a fusion dance.", "On the other hand, G.P. Rouffaer in his book \"Encyclopedie van Niederlandsch Indie editie Stibbe\" (1919) argued that the term \"Pakuan\" should be derived from the word \"paku\" which means \"nail\". The nail represent the king as \"spijker der wereld\" (the nail of world). This is in line with ancient Sundanese tradition that regarded their king as the nail or center of their realm. The tradition to analogically refer the king as \"nail\" is also found in Javanese Surakarta Sunanate tradition that refer their king as Pakubuwono (\"nail of the world\"). Rouffaer further suggested that the term \"Pajajaran\" derived from the term \"sejajar\" (equal), thus Pakuan Pajajaran means \"the king ('nail') of Sunda that was equal to any kings of Java.\"", "Traditional bachata is a subgenre of Bachata (music). It refers to the acoustic style of bachata that was popular in the Dominican Republic from the 1960s until about 1990. For most of that period, bachata was performed with two nylon string guitars (often with fishing line for string), an acoustic upright bass or marimbula, maracas, and bongo drum. Towards the end of the 1980s, Blas Duran and other bachata artists began to perform with electric guitar, and replaced the maracas with the g\u00fcira. The new style that took root is referred to as modern bachata.", "Bachata is a genre of Latin American music that originated in the Dominican Republic in the first half of the 20th century with African, European, and Indigenous musical elements. The first recorded compositions of Bachata were done by Jose Manuel Calderon from the Dominican Republic. Bachata originates from Bolero and Son (and later, from the mid 1980s, Merengue). The original term used to name the genre was \"amargue\" (\"bitterness\", \"bitter music\", or \"blues music\"), until the rather ambiguous (and mood-neutral) term \"bachata\" became popular. The form of dance, bachata, also developed with the music.", "In the modern study of the culture of ancient Greece and Magna Graecia, a pinax (\u03c0\u03af\u03bd\u03b1\u03be) (plural pinakes - \u03c0\u03af\u03bd\u03b1\u03ba\u03b5\u03c2), meaning \"board\", is a votive tablet of painted wood, or terracotta, marble or bronze relief that served as a votive object deposited in a sanctuary or as a memorial affixed within a burial chamber. Such \"pinakes\" feature in the classical collections of most comprehensive museums. To the ancient Greeks \"pinax\" seems also to have been a general term for a plate, but this is generally not followed in modern archaeological usage. In daily life \"pinax\" might equally denote a wax-covered writing tablet. In Christian contexts, painted icons (\"images\") are \"pinakes\". In the theatre of ancient Greece, they were images probably usually painted on cloth, but also carved either in stone or wood, that were hung behind, and sometimes below, the stage area as scenery, or as permanent decoration. The term pinacotheca for a picture gallery derives from such usages.", "A Tala (IAST \"t\u0101la\"), sometimes spelled Taal or Tal, literally means a \"clap, tapping one's hand on one's arm, a musical measure\". It is the term used in Indian classical music to refer to musical meter, that is any rhythmic beat or strike that measures musical time. The measure is typically established by hand clapping, waving, touching fingers on thigh or the other hand, verbally, striking of small cymbals, or a percussion instrument in the Indian subcontinental traditions. Along with \"raga\" which forms the fabric of a melodic structure, the \"tala\" forms the life cycle and thereby constitutes one of the two foundational elements of Indian music.", "The authentic dance from the Dominican Republic in the Caribbean is a basic dance sequence in a full 8-count moving within a square. Dancers in the Western world much later made up a basic step going from side to side, and also copied dance elements from other couple dances of various origins, Latin and non Latin alike. The basic dance sequence consists of three steps and then a tap step or various forms of step syncopation (such as the \"double step\"). Some dancers in the west accompany the tap with an exaggerated \"pop\u201d of the hips. Bachata can be danced on the 1st beat of the musical phrase, with the tap on the 4th beat, but dancing on the 2nd, 3rd or 4th beat is also common. The tap is done on the opposite foot of the last step, while the next step is taken on the same foot as the tap. The dance direction changes after the tap or fourth step."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[46, 62], [44, 62], [54, 72], [40, 62], [296, 315], [121, 139], [62, 84], [38, 52], [154, 176], [25, 64]], "rd_topk": 1}, "test_2094": {"question": "Who did University of Miami play last week", "answer": ["FIU"], "prediction": ["Baltimore Ravens", "New England Patriots", "Tulsa Golden Hurricane", "New England Patriots", "New Orleans Saints", "the New Orleans Saints", "New York Jets", "New England Patriots", "Arizona Cardinals", "North Carolina"], "score": [67.17395782470703, 66.162109375, 65.71968078613281, 65.33960723876953, 65.0614242553711, 64.6431884765625, 64.35733032226562, 64.19795227050781, 64.10850524902344, 63.412574768066406], "title": [["2018 Miami Dolphins season"], ["Miracle in Miami"], ["2016 Miami Beach Bowl"], ["2018 Miami Dolphins season"], ["2017 Miami Dolphins season"], ["2017 Miami Dolphins season"], ["2016 Miami Dolphins season"], ["Kenyan Drake"], ["2016 Miami Dolphins season"], ["2018\u201319 Miami Hurricanes men's basketball team"]], "evidence": ["The 2018 season is the Miami Dolphins' 49th season in the National Football League, their 53rd overall, and their third under head coach Adam Gase. During the offseason, the Dolphins tweaked their uniforms and shade of orange to better align with their classical past and history. For the second straight season, they also brought back their 1970s/80s throwback uniforms and wore them for two games. For the first time since 2012, the Dolphins didn't meet with the Baltimore Ravens during the regular season.", "The Miami Miracle, also known as the Miracle in Miami, was an American football play that took place at the end of a game on December 9, 2018, between the Miami Dolphins and the New England Patriots. Down 33\u201328 with 7 seconds left in the fourth quarter, the Dolphins completed a 17-yard pass and two lateral passes resulting in a 69-yard touchdown by running back Kenyan Drake. It is the first walk-off game-winning touchdown in NFL history to involve multiple lateral passes, and the first multi-lateral touchdown since the River City Relay in December 2003. After the game, the play was known by several names, most commonly the \"Miami Miracle\" and the \"Miracle in Miami\".", "The 2016 Miami Beach Bowl was a post-season American college football bowl game played on December 19, 2016 at Marlins Park in Miami, Florida. The third annual edition of the Miami Beach Bowl was one of the 2016\u201317 bowl games concluding the 2016 FBS football season. The game featured the Central Michigan Chippewas against the Tulsa Golden Hurricane. This was the third meeting between the schools, with the all-time series tied 1\u20131. The most recent meeting was on October 17, 1987, where the Chippewas defeated the Golden Hurricane by a score of 51\u201321. Source:", "With quarterback Ryan Tannehill playing for the first time since 2016, the Dolphins have improved on their 6\u201310 record from last season following a memorable Week 14 win against division rival and defending back-to-back AFC champion New England Patriots, denying them their clinching of the AFC East that week, and are competing for a playoff spot. Draft trades The Dolphins' 2018 schedule was finalized and announced on April 19. Notes Due to two weather delays, the game lasted for 7 hours and 10 minutes, the longest game since the AFL\u2013NFL merger in 1970. Coincidentally, wide receiver Danny Amendola met with former teammates Malcolm Butler and Dion Lewis. The three played for the New England Patriots from 2015 to 2018 and helped them win Super Bowl LI over the Atlanta Falcons. With the win, the Dolphins improved to 3\u20130, their first such start since 2013. With their first loss of the season, the Dolphins failed to earn their first 4\u20130 start since 1995, during the Dan Marino era and Don Shula's final year as the Dolphins' head coach.", "Notes On December 13, 2016, the NFL announced that the Dolphins would play host to the New Orleans Saints as one of the NFL London Games at Wembley Stadium. The game occurred during Week 4 (Sunday, October 1), and was televised in the United States. The remainder of the Dolphins' schedule was finalized and announced on April 20. Note: Intra-division opponents are in bold text. After their week 1 game was postponed due to Hurricane Irma, the Dolphins traveled out to LA to face the new Los Angeles Chargers, where they won 19\u201317 to start the season at 1\u20130. NFL London Games Due to the delayed game of week one, this ended up being the first home game for the Dolphins in the regular season. In a game that was originally going to be played in week 1, but got moved due to Hurricane Irma, the Buccaneers won 30\u201320 thanks to three Jay Cutler interceptions This game marked the end of Jarvis Landry's, Ndamukong Suh's, and Mike Pouncey's tenure in Miami.", "Notes On December 13, 2016, the NFL announced that the Dolphins would play host to the New Orleans Saints as one of the NFL London Games at Wembley Stadium. The game occurred during Week 4 (Sunday, October 1), and was televised in the United States. The remainder of the Dolphins' schedule was finalized and announced on April 20. Note: Intra-division opponents are in bold text. After their week 1 game was postponed due to Hurricane Irma, the Dolphins traveled out to LA to face the new Los Angeles Chargers, where they won 19\u201317 to start the season at 1\u20130. NFL London Games Due to the delayed game of week one, this ended up being the first home game for the Dolphins in the regular season. In a game that was originally going to be played in week 1, but got moved due to Hurricane Irma, the Buccaneers won 30\u201320 thanks to three Jay Cutler interceptions This game marked the end of Jarvis Landry's, Ndamukong Suh's, and Mike Pouncey's tenure in Miami.", "The 2016 Miami Dolphins season was the franchise's 47th season in the National Football League, the 51st overall and the first under head coach Adam Gase. The season saw the Dolphins trying to improve upon their 6\u201310 record from 2015. After a lackluster 1\u20134 start, the Dolphins would claim six straight wins, and finish the season on a 9\u20132 run. With their Week 15 win over the New York Jets, the Dolphins clinched a winning record for the first time since 2008, and clinched a playoff berth the following week after the Kansas City Chiefs defeated the Denver Broncos, ending their 8-year playoff drought. This made Gase the Dolphins' first rookie coach since Tony Sparano to end a year-long playoff drought and also lead them to a winning record of at least 10 wins. They were also the first AFC East team, other than the New England Patriots, to qualify for the postseason since the 2010 New York Jets. However, they were defeated by the Pittsburgh Steelers in the Wild Card round, ending their season and extending their playoff victory drought to 16 years.", "Through the first six games of the Dolphins' 2018 season, Drake had 210 rushing yards and one rushing touchdown to go with 21 receptions for 145 receiving yards and a receiving touchdown. In Week 8, he recorded a rushing and a receiving touchdown in the loss to the Houston Texans. In a Week 14 matchup against the New England Patriots, on the last play of the game Drake caught a lateral and ran for the game winning score as the Dolphins outlasted the Patriots 34-33 in what is now known as the Miracle in Miami.", "Holding a seven-point lead inside the two-minute warning, the Dolphins stopped 49ers quarterback Colin Kaepernick just short of the end zone as time expired to claim a 31\u201324 win. With the win, the Dolphins improved to 7\u20134. This loss snapped the Dolphins' six-game winning streak and they fell to 7\u20135. On a wet day in Miami, Andrew Franks kicked the game-winning field goal as time expired to give the Dolphins a 26\u201323 win over the Arizona Cardinals. With the win, the Dolphins went to 8\u20135. They also snapped their three-game losing streak against the Cardinals. Ryan Tannehill suffered a season-ending knee injury when he was hit low by Calais Campbell although the injury was diagnosed as a sprain and not a torn ACL as was originally feared.", "The 2018\u201319 Miami Hurricanes men's basketball team represents the University of Miami during the 2018\u201319 NCAA Division I men's basketball season. Led by eighth-year head coach Jim Larra\u00f1aga, they play their home games at the Watsco Center on the university's campus in Coral Gables, Florida as members of the Atlantic Coast Conference (ACC). The Hurricanes finished the 2017\u201318 season 22\u201310, 11\u20137 in ACC play to finish in a four-way tie for third place. They lost in the quarterfinals of the ACC Tournament to North Carolina. They received an at-large bid to the NCAA Tournament where they lost in the First Round to Loyola\u2013Chicago. There was no recruiting class of 2018 for Miami (FL). !colspan=12 style=| Exhibition !colspan=12 style=| Non-conference regular season !colspan=12 style=| ACC Regular Season !colspan=12 style=| ACC Tournament *AP does not release post-NCAA Tournament rankings"], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[465, 481], [178, 198], [328, 350], [233, 253], [87, 105], [83, 105], [377, 390], [315, 335], [431, 448], [510, 524]], "rd_topk": 1}, "test_2095": {"question": "When did the United States became a nation", "answer": ["July 4 , 1776", "1776", "In 1776"], "prediction": ["1776", "1776", "July 4, 1776", "1776", "July 2, 1776", "1776", "1776", "1776", "July 4, 1776", "1776"], "score": [95.03875732421875, 93.73565673828125, 93.71746826171875, 91.61214447021484, 91.53802490234375, 91.13778686523438, 91.0494384765625, 90.47093200683594, 90.23309326171875, 90.20896911621094], "title": [["History of the United States"], ["U.S. state"], ["Territorial evolution of the United States"], ["North America"], ["History of the United States (1776\u20131789)"], ["List of U.S. states by date of admission to the Union"], ["List of United States treaties"], ["U.S. state"], ["History of the United States (1776\u20131789)"], ["List of states and territories of the United States"]], "evidence": ["Armed conflict began in 1775. In 1776, the Second Continental Congress declared the independence of the colonies as the United States of America. Led by General George Washington, it won the Revolutionary War with large support from France. The peace treaty of 1783 gave the new nation the land east of the Mississippi River (except Canada and Florida). The Articles of Confederation established a central government, but it was ineffectual at providing stability, as it could not collect taxes and had no executive officer. A convention in 1787 wrote a new Constitution that was adopted in 1789. In 1791, a Bill of Rights was added to guarantee inalienable rights. With Washington as the first president and Alexander Hamilton his chief adviser, a strong central government was created. Purchase of the Louisiana Territory from France in 1803 doubled the size of the United States. A second and final war with Britain was fought in 1812, which solidified national pride.", "The Constitution grants to Congress the authority to admit new states into the Union. Since the establishment of the United States in 1776, the number of states has expanded from the original 13 to 50. Alaska and Hawaii are the most recent states admitted, both in 1959. The Constitution is silent on the question of whether states have the power to secede (withdraw) from the Union. Shortly after the Civil War, the U.S. Supreme Court, in \"Texas v. White\", held that a state cannot unilaterally do so.", "The United States of America was created on July 4, 1776, with the declaration of independence of thirteen British colonies. Their independence was recognized by Great Britain with the Treaty of Paris of 1783, following the American Revolutionary War. This effectively doubled the size of the colonies, now able to stretch west past the Proclamation Line to the Mississippi River. This land was organized into territories and then states, though there remained some conflict with the sea-to-sea grants claimed by some of the original colonies. In time, these grants were ceded to the federal government.", "Britain, Spain, and France took over extensive territories in North America \u2013 and fought over them. In the late 18th century and beginning of the 19th, independence movements that sprung up across the continent, led to the creation of the modern countries in the area. The 13 British colonies on the North Atlantic coast declared independence in 1776, becoming the United States of America. Canada was formed from the unification of northern territories controlled by Britain and France. New Spain, a territory that stretched from modern-day southern US to Central America, declared independence in 1810, becoming the First Mexican Empire. In 1823 the former Captaincy General of Guatemala, then part of the Mexican Empire, became the first independent state in Central America, officially changing its name to the United Provinces of Central America.", "During the winter of 1775\u201376, an attempt by the Patriots to capture Quebec failed, and the buildup of British forces at Halifax, Nova Scotia, precluded that colony from joining the 13 colonies. The Americans were able to capture a British fort at Ticonderoga, New York, and to drag its cannon over the snow to the outskirts of Boston. The appearance of troops and a cannon on Dorchester Heights outside Boston led the British Army to evacuate the city on March 17, 1776. On July 2, 1776, the Second Continental Congress, still meeting in Philadelphia, voted unanimously to declare the independence as the \"United States of America\". Two days later, on July 4, Congress adopted the Declaration of Independence. The drafting of the Declaration was the responsibility of a Committee of Five, which included, among others, John Adams and Benjamin Franklin; it was drafted by Thomas Jefferson and revised by the others and the Congress as a whole. It contended that \"all men are created equal\" with \"certain unalienable rights, that among these are life, liberty, and the pursuit of happiness\", and that \"to secure these rights governments are instituted among men, deriving their just powers from the consent of the governed\", as well as listing the main colonial grievances against the crown. July 4 ever since has been celebrated as the birthday of the United States.", "Article IV, Section 3, Clause 1 of the Constitution grants to Congress the authority to admit new states into the Union. Since the establishment of the United States in 1776, the number of states has expanded from the original 13 to 50. Each new state has been admitted on an equal footing with the existing states. The following table is a list of all 50 states and their respective dates of statehood. The first 13 became states in July 1776 upon agreeing to the United States Declaration of Independence, and each joined the first Union of states between 1777 and 1781, upon ratifying the Articles of Confederation, its first constitution. (A separate table is included below showing AoC ratification dates.) These states are presented in the order in which each ratified the 1787 Constitution, thus joining the present federal Union of states. The date of admission listed for each subsequent state is the official date set by Act of Congress. The Second Continental Congress approved the Articles of Confederation for ratification by the individual states on November 15, 1777. The Articles of Confederation came into force on March 1, 1781, after being ratified by all 13 states. On March 4, 1789, the general government under the Articles was replaced with the federal government under the present Constitution.", "Before the United States Declaration of Independence in 1776, the sovereign of the United Kingdom and the leaders of various North American colonies negotiated treaties that affected the territory of what would later become the USA. These are treaties which the United States has made with other sovereign international states. This is mostly to distinguish them from the next category. Under the treaty clause of the United States Constitution, treaties come into effect upon final ratification by the President of the United States, provided that a two-thirds majority of the United States Senate concurs.", "Article IV also grants to Congress the authority to admit new states into the Union. Since the establishment of the United States in 1776, the number of states has expanded from the original 13 to 50. Each new state has been admitted on an equal footing with the existing states. It also forbids the creation of new states from parts of existing states without the consent of both the affected states and Congress. This caveat was designed to give Eastern states that still had Western land claims (including Georgia, North Carolina, and Virginia), to have a veto over whether their western counties could become states, and has served this same function since, whenever a proposal to partition an existing state or states in order that a region within might either join another state or to create a new state has come before Congress.", "Between 1776 and 1789, the United States of America emerged as an independent country, creating and ratifying its new constitution and establishing its national government. In order to assert their traditional rights, American Patriots seized control of the colonies and launched a war for independence. The Americans declared independence on July 4, 1776, proclaiming \"all men are created equal\". Congress raised the Continental Army under the command of General George Washington, forged a military alliance with France and defeated the two main British invasion armies. Nationalists replaced the governing Articles of Confederation to strengthen the federal government's powers of defense and taxation with the Constitution of the United States of America in 1789, still in effect today.", "States are the primary subdivisions of the United States, and possess a number of powers and rights under the United States Constitution, such as regulating intrastate commerce, running elections, creating local governments, and ratifying constitutional amendments. Each state has its own constitution, grounded in republican principles, and government, consisting of three branches: executive, legislative, and judicial. All states and their residents are represented in the federal Congress, a bicameral legislature consisting of the Senate and the House of Representatives. Each state is represented by two Senators, while Representatives are distributed among the states in proportion to the most recent constitutionally mandated decennial census. Additionally, each state is entitled to select a number of electors to vote in the Electoral College, the body that elects the President of the United States, equal to the total of Representatives and Senators in Congress from that state. Article IV, Section 3, Clause 1 of the Constitution grants to Congress the authority to admit new states into the Union. Since the establishment of the United States in 1776, the number of states has expanded from the original 13 to the current total of 50, and each new state is admitted on an equal footing with the existing states."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[33, 37], [134, 138], [44, 56], [346, 350], [474, 486], [169, 173], [56, 60], [133, 137], [343, 355], [1160, 1164]], "rd_topk": 7}, "test_2096": {"question": "Who plays Ivo on once upon a time", "answer": ["Dan Payne"], "prediction": ["David Anders", "David Anders Holt", "Giles Ingram Matthey", "Jared Scott Gilmore", "Mark Gilbert McKinney,", "Joshua Paul Dallas", "Tyler Jacob Moore", "Parker Croft", "Raphael Sbarge", "Mig Macario"], "score": [81.3880844116211, 80.7406005859375, 80.66810607910156, 80.06282043457031, 79.97471618652344, 79.3173828125, 78.69153594970703, 78.24014282226562, 77.55280303955078, 77.4154281616211], "title": [["David Anders"], ["David Anders"], ["Giles Matthey"], ["Jared S. Gilmore"], ["Gil McKinney"], ["Josh Dallas"], ["Tyler Jacob Moore"], ["Parker Croft"], ["Raphael Sbarge"], ["Mig Macario"]], "evidence": ["David Anders Holt (born March 11, 1981), known professionally as David Anders, is an American television and stage actor. He is best known for his roles as Julian Sark on \"Alias\", as Adam Monroe on \"Heroes\", as John Gilbert in the TV series \"The Vampire Diaries\", as Victor Frankenstein / Dr. Whale on ABC's \"Once Upon a Time\", and as Blaine \"DeBeers\" McDonough on \"iZombie\". Although Anders is American, a few of his roles have required him to use a British Home counties accent. Anders was born in Grants Pass, Oregon, to Dr. Tony and Jeri Holt. Anders has three older siblings: a biological brother (Arik), an adopted brother (Jason), and an adopted sister (Maili).", "David Anders Holt (born March 11, 1981), known professionally as David Anders, is an American television and stage actor. He is best known for his roles as Julian Sark on \"Alias\", as Adam Monroe on \"Heroes\", as John Gilbert in the TV series \"The Vampire Diaries\", as Victor Frankenstein / Dr. Whale on ABC's \"Once Upon a Time\", and as Blaine \"DeBeers\" McDonough on \"iZombie\". Although Anders is American, a few of his roles have required him to use a British Home counties accent. Anders was born in Grants Pass, Oregon, to Dr. Tony and Jeri Holt. Anders has three older siblings: a biological brother (Arik), an adopted brother (Jason), and an adopted sister (Maili).", "Giles Ingram Matthey (born 11 November 1987) is a British-Australian actor best known for his role as Claude Crane on the HBO original series \"True Blood\", Morpheus/Gideon on the ABC series \"Once Upon a Time\" and Jordan Reed on FOX series \"\". Giles Matthey was born in Australia to a British father and an Australian mother. He moved to London with his family at the age of 2. He has one sibling, a younger sister Arabella, who is a Security Consultant. He became interested in acting during his teenage years and eventually moved to New York City. In the US, he completed a two-year conservatory program at the Lee Strasberg Theatre and Film Institute.", "Jared Scott Gilmore (born May 30, 2000) is an American actor. He is best known for his role in the series \"Once Upon a Time\" as Henry Mills. Gilmore was cast as Bobby Draper in \"Mad Men\" in 2009. He was the third actor to play the character, after Maxwell Huckabee and Aaron Hart, since 2007 when the character was originated. In 2011, Jared left \"Mad Men\" and was cast in \"Once Upon a Time\" as Henry Mills, the adopted son of Regina Mills and biological son of Emma Swan and Baelfire. Series creators Adam Horowitz and Eddy Kitsis stated of the role, \"One of our emotional centers was an 11-year-old boy who had to be precocious and vulnerable at the same time.\" Kitsis believed that Gilmore \"naturally brought [these characteristics] out... We just knew he had to be our Henry!\" Gilmore commented, \"I relate to Henry, because I'm 11 and also have a very good imagination. I enjoy making up and playing games in worlds with alternate realities myself.\"", "Mark Gilbert McKinney, known professionally as Gil McKinney, (born February 5, 1979) is an American film and television actor. He is best known for playing Dr. Paul Grady on \"ER\", Derek Bishop on \"Friday Night Lights\", and Prince Eric in \"Once Upon a Time\", and for being the voice and face (via MotionScan) of Jack Kelso in the video game \"L.A. Noire\". Gil also appeared in \"Supernatural\" as Henry Winchester.", "Joshua Paul Dallas (born December 18, 1978) is an American actor. He is best known for his roles as Prince Charming/David Nolan in the ABC television series \"Once Upon a Time\" and Fandral in the Marvel Comics film adaptation \"Thor\". He currently stars as Ben Stone in the NBC drama series \"Manifest\". After graduation at Mountview, Dallas joined the Royal Shakespeare Company, and then took parts with the Royal National Theatre, English National Opera, the New Shakespeare Company and The Young Vic.", "Tyler Jacob Moore (born October 15, 1982) is an American actor. Tyler was born and raised in Catlin, Illinois to Cynthia Donnell and James Moore. He studied musical theater and acting at Palm Beach Atlantic University in West Palm Beach, Florida, and Howard Fine Acting Studio in Los Angeles. Before his days as a professional actor, he served in an Army reconnaissance platoon. Previous to that, some of his various jobs included: Construction on log cabins, youth outreach, and working for Bunge North America (Filling rail cars with grain being sent as foreign aid to various 3rd world countries). He plays Tony Markovich in the Showtime dramedy \"Shameless\". He is also known for his portrayal of Pastor John Tudor on \"GCB\". In July 2014, it was announced that Moore would play Prince Hans on the ABC show \"Once Upon a Time\" and made his debut appearance in the third episode of season 4.", "Parker Croft (born January 13, 1987) is an American actor and screenwriter, most famous for his role as Felix on \"Once Upon a Time\". Parker Croft was born in Burlington, Vermont and raised in Northern Vermont. His mother, Juliet McVicker, is a jazz singer; his father, Parker Hendrick Croft Jr., is an architect, and a painter. Children's theater was Parker\u2019s introduction to acting in 1994, at the age of seven. Soon after, he began working with the Vermont Stage Company. Parker's schooling was varied. He attended public and private schools, as well as experimenting with home schooling. Prior to his graduation from the White Mountain School, Parker received a scholarship to the Perry Mansfield School for the Performing Arts, a summer school for aspiring teen actors. This led him to New York City, where he completed study at the Stella Adler Studio, the William Esper Studio, and the Hubert Berghof Studio.", "Raphael Sbarge (born February 12, 1965) is an American actor, director and producer. He is best known for his roles as Archie Hopper/Jiminy Cricket in \"Once Upon a Time\" and Kaidan Alenko in the \"Mass Effect\" trilogy. Between 2014 and 2016, he portrayed Inspector David Molk in the TNT series \"Murder in the First\". He is also known for voicing Carth Onasi in the video game \"\" and its . Sbarge was born into a theater-oriented family in New York City. His mother, Jeanne was a professional costume designer. His father, Stephen Arnold, was an artist, writer and stage director who named his son after the Renaissance artist. Sbarge began his career at age 4 on \"Sesame Street\".", "Mig Macario is a Filipino-Canadian actor. He plays the iconic role of Bashful of the 7 dwarfs on the hit ABC series \"Once Upon A Time\", the role of George Amahit on the comedy TV series \"Less Than Kind\" and has recurring roles on \"Sanctuary\" & \"The Troop\". Born in the Philippines and named after the Filipino revolutionary, general, and actor Macario Sakay, Mig is the youngest of six children and grew up in Vancouver, British Columbia, Canada. Macario a practicing Nichiren Buddhist with the Soka Gakkai."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0, "se_pos": [[65, 77], [0, 17], [0, 20], [0, 19], [0, 22], [0, 18], [0, 17], [0, 12], [0, 14], [0, 11]], "rd_topk": 1}, "test_2097": {"question": "Who got the most rings in the NBA", "answer": ["Bill Russell"], "prediction": ["Bill Russell", "Boston Celtics center Bill Russell", "Bill Russell", "Red Auerbach", "Phil Jackson", "Grant Hill", "Michael Jordan", "Phil Jackson", "Bill Russell", "Bill Russell"], "score": [90.79521179199219, 87.90135955810547, 80.65617370605469, 79.90157318115234, 79.64404296875, 79.59950256347656, 79.27741241455078, 78.92414855957031, 78.90763092041016, 78.88427734375], "title": [["List of NBA players with most championships"], ["List of NBA players with most championships"], ["Sports in Boston"], ["NBA Championship ring"], ["List of NBA championship head coaches"], ["NBA Sportsmanship Award"], ["Bill Russell NBA Finals Most Valuable Player Award"], ["Red Auerbach"], ["K. C. Jones"], ["Satch Sanders"]], "evidence": ["Boston Celtics center Bill Russell holds the record for the most NBA championships won with 11 titles during his 13-year playing career. He won his first championship with the Boston Celtics in his rookie year. Afterwards, he went on to win ten championships in the next 12 years, including eight consecutive championships from 1959 to 1966. He won the last two championships in 1968 and 1969 as player-coach. Russell's teammate, Sam Jones, won ten championships from 1959 to 1969, the second most in NBA history. Four Celtics players, Tom Heinsohn, K. C. Jones, Satch Sanders and John Havlicek, won eight championships each. Two other Celtics, Jim Loscutoff and Frank Ramsey, won seven championships each. Four players, Bob Cousy, Kareem Abdul-Jabbar, Michael Jordan and Scottie Pippen, won six championships each. Jordan and Pippen are members of the Chicago Bulls team who won three consecutive championships twice in the 1990s. George Mikan won two championships in the NBL before it merged with the BAA to form the NBA, and won five championships in the NBA.", "Boston Celtics center Bill Russell holds the record for the most NBA championships won with 11 titles during his 13-year playing career. He won his first championship with the Boston Celtics in his rookie year. Afterwards, he went on to win ten championships in the next 12 years, including eight consecutive championships from 1959 to 1966. He won the last two championships in 1968 and 1969 as player-coach. Russell's teammate, Sam Jones, won ten championships from 1959 to 1969, the second most in NBA history. Four Celtics players, Tom Heinsohn, K. C. Jones, Satch Sanders and John Havlicek, won eight championships each. Two other Celtics, Jim Loscutoff and Frank Ramsey, won seven championships each. Four players, Bob Cousy, Kareem Abdul-Jabbar, Michael Jordan and Scottie Pippen, won six championships each. Jordan and Pippen are members of the Chicago Bulls team who won three consecutive championships twice in the 1990s. George Mikan won two championships in the NBL before it merged with the BAA to form the NBA, and won five championships in the NBA.", "The Boston Celtics basketball team, who play at the TD Garden, were a founding member of the Basketball Association of America, one of the two leagues that merged to form the National Basketball Association. The Celtics have the distinction of having more Championships than any other NBA team with 17 championships from 1957 to 2008. They had a remarkable run of titles from the 1956\u201357 until the 1968\u201369 seasons, winning 11 of 13 championships in that span, including an NBA record 8 titles in a row from 1958\u201359 until 1965\u201366, under legendary center Bill Russell.", "The NBA Championship ring is an annual award given by the National Basketball Association to the team that wins the NBA Finals. Rings are presented to the team's players, coaches, and members of the executive front office. Red Auerbach has the most rings overall with 16. Phil Jackson has the most as coach and Bill Russell has the most as a player (11 each) NBA Championship rings have been handed out since the first NBA Finals in 1947. In the modern era, the rings are handed to the defending champions during the team's first home game each season. NBA Championship rings are silver or gold and include the following features: In three NBA Finals, John Havlicek chose two wrist watches and a liqueur tray set as commemorative items.", "Former Los Angeles Lakers head coach Phil Jackson won eleven NBA championships, the most in NBA history. He won six titles with the Chicago Bulls and five titles with the Lakers, and is the only coach who has won multiple championships with more than one team. Red Auerbach won nine championships with the Boston Celtics and won eight consecutive titles from to . John Kundla, Pat Riley, and current San Antonio Spurs head coach Gregg Popovich have each won five championships. Kundla won all of his titles with the Lakers, and Popovich has won all of his titles with the Spurs, while Riley won four titles with the Lakers and one with the Miami Heat. Current Golden State Warriors head coach Steve Kerr has won three championships, while current Miami Heat head coach Erik Spoelstra has won two titles. Los Angeles Clippers head coach Doc Rivers, Dallas Mavericks head coach Rick Carlisle, and Cleveland Cavaliers head coach Tyronn Lue are the only other active coaches who have won a championship, Rivers having won while with the Boston Celtics in 2008.", "The NBA Sportsmanship Award is an annual National Basketball Association (NBA) award given to a player who most \"exemplifies the ideals of sportsmanship on the court with ethical behavior, fair play, and integrity.\" It is directly analogous to the Kim Perrot Sportsmanship Award, which has been awarded by the NBA's sister league, the WNBA, with neither award demanding excellence of play. Every year, each of the 30 NBA teams nominates one of its players to compete for this award. From these nominees, one player from each NBA division are selected by a panel as the divisional Sportsmanship Award winners. At the end of the regular season, players in the league cast votes for the award, with eleven points given for each first-place vote, nine for second-place vote, seven points for third, five points for fourth, three points for fifth and one point for each sixth place vote received. The player with the highest point total, regardless of the number of first-place votes, wins the award and presented with the Joe Dumars Trophy; named after the former Detroit Pistons player and the award's inaugural recipient. Grant Hill has won the award three times; the most in NBA history. Kemba Walker, Jason Kidd and Mike Conley are the only other players to have won it multiple times, each having done so twice.", "Since its inception, the award has been given to 31 players. Michael Jordan is a record six-time award winner. Magic Johnson, Shaquille O'Neal, Tim Duncan and LeBron James won the award three times in their careers. Jordan and O'Neal are the only players to win the award in three consecutive seasons (Jordan accomplished the feat on two separate occasions). Johnson is the only rookie ever to win the award, as well as the youngest at 20 years old. Andre Iguodala is the only winner to have not started every game in the series. Jerry West, the first ever awardee, is the only person to win the award while being on the losing team in the NBA Finals. Willis Reed, Kareem Abdul-Jabbar, Larry Bird, Hakeem Olajuwon, Kobe Bryant, and Kevin Durant won the award twice. Olajuwon, Durant, Bryant, and James have won the award in two consecutive seasons. Abdul-Jabbar and James are the only players to win the award for two teams. Olajuwon of Nigeria, who became a naturalized U.S. citizen in 1993, Tony Parker of France, and Dirk Nowitzki of Germany are the only international players to win the award. Duncan is an American citizen, but is considered an \"international\" player by the NBA because he was not born in one of the fifty states or Washington, D.C. Parker and Nowitzki are the only winners to have been trained totally outside the U.S.; Olajuwon played college basketball at Houston and Duncan at Wake Forest. Cedric Maxwell is the only Finals MVP winner eligible for the Hall of Fame who has not been voted in. On February 14, 2009, during the 2009 NBA All-Star Weekend in Phoenix, then-NBA Commissioner David Stern announced that the award would be renamed the \"Bill Russell NBA Finals Most Valuable Player Award\" in honor of 11-time NBA champion Bill Russell.", "Arnold Jacob \"Red\" Auerbach (September 20, 1917 \u2013 October 28, 2006) was an American basketball coach of the Washington Capitols, the Tri-Cities Blackhawks and the Boston Celtics. After he retired from coaching, he served as president and front office executive of the Celtics until his death. As a coach, he won 938 games (a record at his retirement) and nine National Basketball Association (NBA) championships in ten years (a number surpassed only by Phil Jackson, who won 11 in twenty years). As general manager and team president of the Celtics, he won an additional seven NBA titles, for a grand total of 16 in a span of 29 years, making him one of the most successful team officials in the history of North American professional sports.", "In NBA history, only teammates Bill Russell (11 championships) and Sam Jones (10 championships) have won more championship rings during their playing careers. After Boston lost to the Philadelphia 76ers in the 1967 playoffs, Jones ended his playing career. K.C. Jones was enshrined in the Naismith Memorial Basketball Hall of Fame in 1989. Jones began his coaching career at Brandeis University, serving as the head coach from 1967 to 1970. Jones served as an assistant coach at Harvard University from 1970 to 1971. Jones then reunited with former teammate Bill Sharman as the assistant coach for the 1971\u201372 NBA champion Los Angeles Lakers during the season the team won a record 33 straight games. The following season, Jones became the first coach of the San Diego Conquistadors, an American Basketball Association franchise which would have a very short life. A year later, in 1973 he became head coach of the Capital Bullets (which became the Washington Bullets one year later), coaching them for three seasons and leading them to the NBA Finals in 1975.", "Thomas Ernest \"Satch\" Sanders (born November 8, 1938) is an American retired college and professional basketball player and coach. He was a 6'6\", 210 lb power forward. Sanders is tied for third for most NBA championships in a career, and is one of three NBA players with an unsurpassed 8\u20130 record in NBA Finals series outcomes. On April 4, 2011, it was announced that Sanders was elected to the 2011 class to enter the Naismith Basketball Hall of Fame as a contributor. After playing at New York University as a stand out collegian he spent all of his 13 years in the National Basketball Association (NBA) with the Boston Celtics, being part of eight championship teams in 1961\u201366, 1968 and 1969. In NBA history, only teammates Bill Russell and Sam Jones have won more championship rings during their playing careers. He ended his career in 1973."], "em_top1": true, "em_top10": true, "f1_top1": 1.0, "f1_top10": 1.0, "se_pos": [[22, 34], [0, 34], [553, 565], [223, 235], [37, 49], [1120, 1130], [61, 75], [453, 465], [31, 43], [728, 740]], "rd_topk": 4}, "test_2098": {"question": "What book of the Bible is the song of Solomon in", "answer": ["Song of Solomon", "Song of Songs"], "prediction": ["Old Testament", "the Old Testament", "a book of the Old Testament", "Testament", "book of the Old Testament", "Book of Kings", "the Book of Kings", "1 Kings", "Book of Exodus", "First Book of Kings"], "score": [87.89387512207031, 87.86526489257812, 85.7947006225586, 85.16635131835938, 85.12104034423828, 84.94146728515625, 84.41914367675781, 84.38119506835938, 83.13793182373047, 82.71844482421875], "title": [["Song of Songs"], ["Song of Songs"], ["Song of Songs"], ["Song of Songs"], ["Song of Songs"], ["Judgment of Solomon"], ["Judgment of Solomon"], ["Judgment of Solomon"], ["Song of the Sea"], ["Solomon (Handel)"]], "evidence": ["The Song of Songs, also Song of Solomon or Canticles (Hebrew: \"\u0160\u00eer Ha\u0160\u00eer\u00eem\", Greek: \"\u00c2isma \u0100ism\u00e1t\u014dn\"), is one of the \"megillot\" (scrolls) found in the last section of the Tanakh, known as the Ketuvim (or \"Writings\"), and a book of the Old Testament. The Song of Songs is unique within the Hebrew Bible: it shows no interest in Law or Covenant or Yahweh the God of Israel, nor does it teach or explore wisdom like Proverbs or Ecclesiastes (although it does have some affinities to wisdom literature, as the ascription to Solomon indicates); instead, it celebrates sexual love, giving \"the voices of two lovers, praising each other, yearning for each other, proffering invitations to enjoy\". The two are in harmony, each desiring the other and rejoicing in sexual intimacy; the women of Jerusalem form a chorus to the lovers, functioning as an audience whose participation in the lovers' erotic encounters facilitates the participation of the reader.", "The Song of Songs, also Song of Solomon or Canticles (Hebrew: \"\u0160\u00eer Ha\u0160\u00eer\u00eem\", Greek: \"\u00c2isma \u0100ism\u00e1t\u014dn\"), is one of the \"megillot\" (scrolls) found in the last section of the Tanakh, known as the Ketuvim (or \"Writings\"), and a book of the Old Testament. The Song of Songs is unique within the Hebrew Bible: it shows no interest in Law or Covenant or Yahweh the God of Israel, nor does it teach or explore wisdom like Proverbs or Ecclesiastes (although it does have some affinities to wisdom literature, as the ascription to Solomon indicates); instead, it celebrates sexual love, giving \"the voices of two lovers, praising each other, yearning for each other, proffering invitations to enjoy\". The two are in harmony, each desiring the other and rejoicing in sexual intimacy; the women of Jerusalem form a chorus to the lovers, functioning as an audience whose participation in the lovers' erotic encounters facilitates the participation of the reader.", "The Song of Songs, also Song of Solomon or Canticles (Hebrew: \"\u0160\u00eer Ha\u0160\u00eer\u00eem\", Greek: \"\u00c2isma \u0100ism\u00e1t\u014dn\"), is one of the \"megillot\" (scrolls) found in the last section of the Tanakh, known as the Ketuvim (or \"Writings\"), and a book of the Old Testament. The Song of Songs is unique within the Hebrew Bible: it shows no interest in Law or Covenant or Yahweh the God of Israel, nor does it teach or explore wisdom like Proverbs or Ecclesiastes (although it does have some affinities to wisdom literature, as the ascription to Solomon indicates); instead, it celebrates sexual love, giving \"the voices of two lovers, praising each other, yearning for each other, proffering invitations to enjoy\". The two are in harmony, each desiring the other and rejoicing in sexual intimacy; the women of Jerusalem form a chorus to the lovers, functioning as an audience whose participation in the lovers' erotic encounters facilitates the participation of the reader.", "The Song of Songs, also Song of Solomon or Canticles (Hebrew: \"\u0160\u00eer Ha\u0160\u00eer\u00eem\", Greek: \"\u00c2isma \u0100ism\u00e1t\u014dn\"), is one of the \"megillot\" (scrolls) found in the last section of the Tanakh, known as the Ketuvim (or \"Writings\"), and a book of the Old Testament. The Song of Songs is unique within the Hebrew Bible: it shows no interest in Law or Covenant or Yahweh the God of Israel, nor does it teach or explore wisdom like Proverbs or Ecclesiastes (although it does have some affinities to wisdom literature, as the ascription to Solomon indicates); instead, it celebrates sexual love, giving \"the voices of two lovers, praising each other, yearning for each other, proffering invitations to enjoy\". The two are in harmony, each desiring the other and rejoicing in sexual intimacy; the women of Jerusalem form a chorus to the lovers, functioning as an audience whose participation in the lovers' erotic encounters facilitates the participation of the reader.", "The Song of Songs, also Song of Solomon or Canticles (Hebrew: \"\u0160\u00eer Ha\u0160\u00eer\u00eem\", Greek: \"\u00c2isma \u0100ism\u00e1t\u014dn\"), is one of the \"megillot\" (scrolls) found in the last section of the Tanakh, known as the Ketuvim (or \"Writings\"), and a book of the Old Testament. The Song of Songs is unique within the Hebrew Bible: it shows no interest in Law or Covenant or Yahweh the God of Israel, nor does it teach or explore wisdom like Proverbs or Ecclesiastes (although it does have some affinities to wisdom literature, as the ascription to Solomon indicates); instead, it celebrates sexual love, giving \"the voices of two lovers, praising each other, yearning for each other, proffering invitations to enjoy\". The two are in harmony, each desiring the other and rejoicing in sexual intimacy; the women of Jerusalem form a chorus to the lovers, functioning as an audience whose participation in the lovers' erotic encounters facilitates the participation of the reader.", "Scholars point out that the story is linked to the preceding account of Solomon's dream in Gibeon, by the common pattern of prophetic dream and its subsequent fulfillment. Some think this proximity of the stories results from the work of a redactor. Others, such as Saul Zalewski, consider the two accounts to be inseparable and to form a literarily unified unit. In its broader context, the Judgment of Solomon forms part of the account of Solomon's reign, generally conceived as a distinct segment in the Book of Kings, compassing chapters 3\u201311 in 1 Kings; Some include in it also chapters 1\u20132, while others think that these chapters originally ended the account of David's reign in 2 Samuel. According to Liver, the source for the Judgment of Solomon story, as well as other parts of the account of Solomon's reign, is in the speculated book of the Acts of Solomon, which he proposes to be a wisdom work which originated in the court circles shortly after the split of the united monarchy.", "Scholars point out that the story is linked to the preceding account of Solomon's dream in Gibeon, by the common pattern of prophetic dream and its subsequent fulfillment. Some think this proximity of the stories results from the work of a redactor. Others, such as Saul Zalewski, consider the two accounts to be inseparable and to form a literarily unified unit. In its broader context, the Judgment of Solomon forms part of the account of Solomon's reign, generally conceived as a distinct segment in the Book of Kings, compassing chapters 3\u201311 in 1 Kings; Some include in it also chapters 1\u20132, while others think that these chapters originally ended the account of David's reign in 2 Samuel. According to Liver, the source for the Judgment of Solomon story, as well as other parts of the account of Solomon's reign, is in the speculated book of the Acts of Solomon, which he proposes to be a wisdom work which originated in the court circles shortly after the split of the united monarchy.", "Scholars point out that the story is linked to the preceding account of Solomon's dream in Gibeon, by the common pattern of prophetic dream and its subsequent fulfillment. Some think this proximity of the stories results from the work of a redactor. Others, such as Saul Zalewski, consider the two accounts to be inseparable and to form a literarily unified unit. In its broader context, the Judgment of Solomon forms part of the account of Solomon's reign, generally conceived as a distinct segment in the Book of Kings, compassing chapters 3\u201311 in 1 Kings; Some include in it also chapters 1\u20132, while others think that these chapters originally ended the account of David's reign in 2 Samuel. According to Liver, the source for the Judgment of Solomon story, as well as other parts of the account of Solomon's reign, is in the speculated book of the Acts of Solomon, which he proposes to be a wisdom work which originated in the court circles shortly after the split of the united monarchy.", "The Song of the Sea (, Shirat HaYam, also known as Az Yashir Moshe and Song of Moses, or Mi Chamocha) is a poem that appears in the Book of Exodus of the Hebrew Bible, at . It is followed in verses 20 and 21 by a much shorter song sung by Miriam and the other women. The Song of the Sea was reputedly sung by the Israelites after their crossing the Red Sea in safety, and celebrates the destruction of the Egyptian army during the crossing, and looks forward to the future conquest of Canaan. The poem is included in Jewish prayer books, and recited daily in the morning shacharit services. The poem also comprises the first ode or hymn of the Eastern Orthodox canon, where it is known as the Song or Ode of Moses. It is also used in the Roman Catholic, Eastern Orthodox, and other Christian liturgies at the Easter Vigil when the history of salvation is recounted. These traditions follow by calling it the \"Song of Moses\" (not to be confused with the Song of Moses in Deuteronomy).", "Solomon, HWV 67, is an English oratorio by George Frideric Handel. The anonymous libretto \u2013 currently thought to have been penned by the English Jewish poet/playwright Moses Mendes (d.1758) \u2013 is based on the biblical stories of the wise king Solomon from the First Book of Kings and the Second Book of Chronicles, with additional material from \"Antiquities of the Jews\" by ancient historian Flavius Josephus. The music was composed between 5 May and 13 June 1748, and the first performance took place on 17 March 1749, with Caterina Galli in the title role at the Covent Garden Theatre in London, where it had two further performances. Handel revived the work in 1759."], "em_top1": false, "em_top10": false, "f1_top1": 0, "f1_top10": 0.3333333333333333, "se_pos": [[235, 248], [231, 248], [221, 248], [239, 248], [223, 248], [507, 520], [503, 520], [550, 557], [132, 146], [259, 278]], "rd_topk": 2}, "test_2099": {"question": "Songs on 4 your Eyez only J Cole", "answer": ["Change", "For Whom the Bell Tolls", "She 's Mine Pt. 1", "She 's Mine Pt. 2", "4 Your Eyez Only", "Neighbors", "Immortal", "Deja Vu", "Foldin Clothes", "Ville Mentality"], "prediction": ["Deja Vu", "Deja Vu", "\"Deja Vu", "Deja Vu\"", "\"Neighbors\".", "Deja Vu\"", "Deja Vu", "Tolls", "\"Deja Vu\"", "Deja Vu"], "score": [80.25789642333984, 79.64105224609375, 79.21871948242188, 78.45799255371094, 78.38957214355469, 77.83650207519531, 77.80911254882812, 77.37560272216797, 77.1732177734375, 76.6447982788086], "title": [["4 Your Eyez Only"], ["4 Your Eyez Only"], ["4 Your Eyez Only"], ["4 Your Eyez Only"], ["4 Your Eyez Only"], ["4 Your Eyez Only"], ["4 Your Eyez Only"], ["4 Your Eyez Only"], ["4 Your Eyez Only"], ["J. Cole"]], "evidence": ["The album was supported by two singles: \"Deja Vu,\" and \"Neighbors\". All 10 songs from \"4 Your Eyez Only\" debuted in the top 40 of the US \"Billboard\" Hot 100. Cole achieved twelve simultaneous Hot 100 entries in a single week. Promoting the release, Cole released a one-hour documentary (by the same name) on April 15, 2017 on HBO, featuring music from the album. In June 2017, Cole embarked on the 4 Your Eyez Only World Tour, to promote the album. \"4 Your Eyez Only\" debuted at number one on the US \"Billboard\" 200, selling 363,000 copies in its first week (492,000 with additional album-equivalent units), earning Cole his fourth consecutive number-one album in the country. It had the third-largest weekly sales for an album in 2016. The album also debuted at number one on \"Billboard\"s Canadian Albums Chart. The reception for \"4 Your Eyez Only\" was generally positive, many critics praised Cole's songwriting and called it his best and most mature album to date. It appeared on several music publications' year-end lists. On January 12, 2017, \"4 Your Eyez Only\" was certified Gold by the Recording Industry Association of America, and was certified Platinum on April 7, 2017.", "\"Deja Vu\" entered the US \"Billboard\" Hot 100 at number 7 without being released as a single at the time, becoming Cole's highest charting song. All 10 songs from \"4 Your Eyez Only\" debuted in the top 40 of the Hot 100, after only having four top 40 entries as a solo artist. Cole achieved twelve simultaneous Hot 100 entries in a single week. \"4 Your Eyez Only\" was ranked as the tenth most popular album of 2017 on the \"Billboard\" 200. Upon the release of \"Eyez\" documentary, \"Everybody Dies\" and \"False Prophets\" caused controversy within the hip hop community, as many assumed that \"Everybody Dies\" contained shots aimed at fellow rappers Lil Uzi Vert and Lil Yachty. During an interview with Los Angeles' radio station Power 106, Lil Yachty responded, saying: \"I don't listen to J. Cole [but] I definitely listened to it [and] people said he was talking about me. He said 'Lil.' I'm not little. My name has 'Lil' in it but there's a lot of 'Lil' rappers. [It's] either me or Uzi. Honestly, I don't give a fuck.\" Lil Uzi Vert acknowledged the track, he responded via Twitter on December 2, 2016 by simply tweeting, \"Heard some beautiful shit today @JColeNC\" People also argued that the first verse on \"False Prophets\" consisted of direct shots at", "The album was supported by two singles: \"Deja Vu,\" and \"Neighbors\". All 10 songs from \"4 Your Eyez Only\" debuted in the top 40 of the US \"Billboard\" Hot 100. Cole achieved twelve simultaneous Hot 100 entries in a single week. Promoting the release, Cole released a one-hour documentary (by the same name) on April 15, 2017 on HBO, featuring music from the album. In June 2017, Cole embarked on the 4 Your Eyez Only World Tour, to promote the album. \"4 Your Eyez Only\" debuted at number one on the US \"Billboard\" 200, selling 363,000 copies in its first week (492,000 with additional album-equivalent units), earning Cole his fourth consecutive number-one album in the country. It had the third-largest weekly sales for an album in 2016. The album also debuted at number one on \"Billboard\"s Canadian Albums Chart. The reception for \"4 Your Eyez Only\" was generally positive, many critics praised Cole's songwriting and called it his best and most mature album to date. It appeared on several music publications' year-end lists. On January 12, 2017, \"4 Your Eyez Only\" was certified Gold by the Recording Industry Association of America, and was certified Platinum on April 7, 2017.", "\"Deja Vu\" entered the US \"Billboard\" Hot 100 at number 7 without being released as a single at the time, becoming Cole's highest charting song. All 10 songs from \"4 Your Eyez Only\" debuted in the top 40 of the Hot 100, after only having four top 40 entries as a solo artist. Cole achieved twelve simultaneous Hot 100 entries in a single week. \"4 Your Eyez Only\" was ranked as the tenth most popular album of 2017 on the \"Billboard\" 200. Upon the release of \"Eyez\" documentary, \"Everybody Dies\" and \"False Prophets\" caused controversy within the hip hop community, as many assumed that \"Everybody Dies\" contained shots aimed at fellow rappers Lil Uzi Vert and Lil Yachty. During an interview with Los Angeles' radio station Power 106, Lil Yachty responded, saying: \"I don't listen to J. Cole [but] I definitely listened to it [and] people said he was talking about me. He said 'Lil.' I'm not little. My name has 'Lil' in it but there's a lot of 'Lil' rappers. [It's] either me or Uzi. Honestly, I don't give a fuck.\" Lil Uzi Vert acknowledged the track, he responded via Twitter on December 2, 2016 by simply tweeting, \"Heard some beautiful shit today @JColeNC\" People also argued that the first verse on \"False Prophets\" consisted of direct shots at", "On March 24, 2017 HBO announced a second documentary with Cole tiled, \"J. Cole: 4 Your Eyez Only\", the first being \"\" in 2016, the documentary aired April 15, 2017 on HBO and HBO Now. Incorporating music from \"4 Your Eyez Only\", Cole captured stories of residents in Baton Rouge, Louisiana, Atlanta, Georgia, Ferguson, Missouri, his father's hometown, Jonesboro, Arkansas and his hometown, Fayetteville, North Carolina. \"Entertainment Weekly\" reported, \"The documentary promises to illustrate how their struggles over viable housing, voting laws for felons, integration, and more mirror the frustrations felt across the nation.\" The documentary included security camera footage of a SWAT raid that took place on March 18, 2016 at Cole's North Carolina home studio, which served as inspiration for the track \"Neighbors\". Cole also previewed new music in the documentary. The film was directed by Cole and Scott Lazer. The documentary was exclusively screened at the Troxy in London on April 19, 2017. On May 1, 2017 the film was uploaded on Dreamville's YouTube channel. Writing for \"Billboard\", J'na Jefferson praised the film saying it \"brings black perseverance to the forefront\". Cole spoke about the documentary with \"The New York Times\" saying:", "On January 10, 2017, \"Deja Vu\" was serviced to American mainstream urban radio, as the album's first single. The single debuted at number 7 on the US \"Billboard\" Hot 100, becoming Cole's first top 10 song. The single also debuted at number 4 on the US Hot R&B/Hip-Hop Songs.