In EUREQA, every question is constructed through an implicit reasoning chain. The chain is constructed by parsing DBPedia. Each layer comprises three components: an entity, a fact about the entity, and a relation between the entity
and its counterpart from the next layer. The layers stack up to create chains with different depths of reasoning. We verbalize reasoning chains into natural sentences and anonymize the entity of each layer to create the question.
Questions can be solved layer by layer and each layer is guaranteed a unique answer. EUREQA is not a knowledge game: we adopt a knowledge filtering process that ensures that most LLMs have sufficient world knowledge to answer our questions.
EUREQA comprises a total of 2,991 questions of different reasoning depths and difficulties. The entities encompass a broad spectrum of topics, effectively reducing any potential bias arising from specific entity categories.
These data are great for analyzing the reasoning processes of LLMs
PerformanceHere we present the accuracy of ChatGPT, Gemini-Pro and GPT-4 on the hard set of EUREQA across different depths d of reasoning (number of layers in the questions). We evaluate two prompt strategies: direct zero-shot prompt and ICL with two examples. In general, with the entities recursively substituted by the descriptions of reasoning chaining layers, and therefore eliminating surface-level semantic cues, these models generate more incorrect answers. When the reasoning depth increases from one to five on hard questions, there is a notable decline in performance for all models. This finding underscores the significant impact that semantic shortcuts have on the accuracy of responses, and it also indicates that GPT-4 is considerably more capable of identifying and taking advantage of these shortcuts.
| depth | d=1 | d=2 | d=3 | d=4 | d=5 | |||||
| direct | icl | direct | icl | direct | icl | direct | icl | direct | icl | |
| ChatGPT | 22.3 | 53.3 | 7.0 | 40.0 | 5.0 | 39.2 | 3.7 | 39.3 | 7.2 | 39.0 |
| Gemini-Pro | 45.0 | 49.3 | 29.5 | 23.5 | 27.3 | 28.6 | 25.7 | 24.3 | 17.2 | 21.5 |
| GPT-4 | 60.3 | 76.0 | 50.0 | 63.7 | 51.3 | 61.7 | 52.7 | 63.7 | 46.9 | 61.9 |
Leslie Easterbrook: An Icon of 80s Cinema and Beyond Leslie Easterbrook is an enduring figure in Hollywood, celebrated for her versatility across comedy, drama, and horror. Best known as the formidable Sgt. Debbie Callahan in the Police Academy franchise, she redefined female authority on screen with a blend of commanding presence and sharp comedic timing. Her career, spanning over four decades, includes iconic television roles, vocal performances, and a second act as a favorite in the horror genre. The Career of Leslie Easterbrook
Low-quality versions of these photos look like fuzzy behind-the-scenes stills. High-quality versions look like Edward Hopper paintings with a sense of humor. This is why discerning collectors refuse to settle for 72 DPI web images.
Easterbrook has kept her personal life relatively private over the years. However, it is known that she has been married twice and has two children. She currently resides in California, where she remains involved in the entertainment industry. playboy leslie easterbrook high quality
Legacy: Leslie Easterbrook's legacy as a Playboy Bunny and actress has made her a figure of interest for those who follow vintage Playboy models and 1970s and 1980s pop culture.
Searching for "Playboy Leslie Easterbrook high quality" isn't just a quest for nudity; it is a search for a specific era of photography. It is a demand for resolution, lighting, composition, and the celebration of a mature, confident female form. This article dives deep into why Leslie Easterbrook’s tenure with Playboy remains a benchmark for high-quality visual art. Leslie Easterbrook: An Icon of 80s Cinema and
Classic Composition: Unlike many contemporary shoots that rely on shock value, Leslie’s photos leaned into the "Golden Age of Hollywood" style—elegant, poised, and statuesque.
Her character, Sgt. Debbie Callahan, was a revolutionary archetype for the decade. She was sexually liberated without being a victim; she was physically dangerous without being masculine. Easterbrook famously performed many of her own stunts, including the brutal fight scenes in Police Academy 3: Back in Training. Playboy Playmate of the Month (August 1980) :
Leslie Easterbrook's appearance in Playboy marked a milestone in her career, symbolizing her transition from a small-town girl to a recognized figure in the entertainment industry. Her centerfold feature has become iconic, representing the charm and charisma of the era.
This website is adapted from Nerfies, UniversalNER and LLaVA, licensed under a Creative Commons Attribution-ShareAlike 4.0 International License. We thank the LLaMA team for giving us access to their models.
Usage and License Notices: The data abd code is intended and licensed for research use only. They are also restricted to uses that follow the license agreement of LLaMA, ChatGPT, and the original dataset used in the benchmark. The dataset is CC BY NC 4.0 (allowing only non-commercial use) and models trained using the dataset should not be used outside of research purposes.