262 lines
7.1 KiBLFS
Markdown
262 lines
7.1 KiBLFS
Markdown
|
|
# Task Hierarchy
|
|
|
|
## Guidelines / FAQs for Contributors:
|
|
|
|
- Massaging the task hierarchy categories is somewhat encouraged.
|
|
- `src/auto_add_domain.py` is helpful for adding domains for all tasks in any particular dataset
|
|
|
|
## Task Categories
|
|
|
|
- `Translation`
|
|
- `Question Answering`
|
|
- `Program Execution`
|
|
- `Question Generation`
|
|
- `Sentiment Analysis`
|
|
- `Text Categorization`
|
|
- `Text Matching`
|
|
- `Toxic Language Detection`
|
|
- `Cause Effect Classification`
|
|
- `Information Extraction`
|
|
- `Textual Entailment`
|
|
- `Wrong Candidate Generation`
|
|
- `Named Entity Recognition`
|
|
- `Commonsense Classification`
|
|
- `Fill in The Blank`
|
|
- `Text Completion`
|
|
- `Sentence Composition`
|
|
- `Title Generation`
|
|
- `Language Identification`
|
|
- `Question Understanding`
|
|
- `Sentence Perturbation`
|
|
- `Answerability Classification`
|
|
- `Summarization`
|
|
- `Coreference Resolution`
|
|
- `Text Quality Evaluation`
|
|
- `Text to Code`
|
|
- `Paraphrasing`
|
|
- `Dialogue Generation`
|
|
- `Question Rewriting`
|
|
- `Word Semantics`
|
|
- `Pos Tagging`
|
|
- `Linguistic Probing`
|
|
- `Story Composition`
|
|
- `Speaker Identification`
|
|
- `Word Analogy`
|
|
- `Data to Text`
|
|
- `Stereotype Detection`
|
|
- `Negotiation Strategy Detection`
|
|
- `Dialogue Act Recognition`
|
|
- `Gender Classification`
|
|
- `Coherence Classification`
|
|
- `Explanation`
|
|
- `Ethics Classification`
|
|
- `Word Relation Classification`
|
|
- `Sentence Ordering`
|
|
- `Answer Verification`
|
|
- `Mathematics`
|
|
- `Intent Identification`
|
|
- `Keyword Tagging`
|
|
- `Code to Text`
|
|
- `Dialogue State Tracking`
|
|
- `Text Simplification`
|
|
- `Stance Detection`
|
|
- `Fact Verification`
|
|
- `Grammar Error Detection`
|
|
- `Section Classification`
|
|
- `Number Conversion`
|
|
- `Style Transfer`
|
|
- `Speaker Relation Classification`
|
|
- `Irony Detection`
|
|
- `Question Decomposition`
|
|
- `Overlap Extraction`
|
|
- `Grammar Error Correction`
|
|
- `Spelling Error Detection`
|
|
- `Entity Generation`
|
|
- `Sentence Expansion`
|
|
- `Discourse Connective Identification`
|
|
- `Discourse Relation Classification`
|
|
- `Poem Generation`
|
|
- `Entity Relation Classification`
|
|
- `Punctuation Error Detection`
|
|
- `Spam Classification`
|
|
- `Paper Review`
|
|
- `Sentence Compression`
|
|
- `Preposition Prediction`
|
|
- `Misc.`
|
|
|
|
## Reasoning
|
|
|
|
- `Abductive Reasoning`
|
|
- `Analogical Reasoning`
|
|
- `Argument Reasoning`
|
|
- `Causal Reasoning`
|
|
- `Commonsense Reasoning`: Tasks related to activities humans do in daily life e.g. eating breakfast in the morning, sleeping during night etc.
|
|
- `Commonsense Reasoning -> Numerical Commonsense Reasoning`: Tasks which requires numerical commonsense knowledge e.g. a car has 4 wheels.
|
|
- `Commonsense Reasoning -> Physical Reasoning`: Tasks involving physical interactions with objects e.g. a knife (and not a paper) is used to cut objects
|
|
- `Commonsense Reasoning -> Social Situations`
|
|
- `Commonsense Reasoning -> Spatial Reasoning`
|
|
- `Counterfactual Reasoning`
|
|
- `Cross-document Reasoning`
|
|
- `Deductive Reasoning`
|
|
- `Discrete Reasoning`
|
|
- `Ethical Judgement`
|
|
- `Ethics`
|
|
- `Grammatical Reasoning`
|
|
- `Logical Reasoning`
|
|
- `Logical Reasoning -> Reasoning with Symbols`: Tasks where symbols represent various things e.g. if X is the number of apples in the fridge today morning and Y is the number remaining after I ate a few apples, X-Y is the number of apples I ate.
|
|
- `Mathematics`
|
|
- `Mathematics -> Algebra`
|
|
- `Mathematics -> Arithmetic`
|
|
- `Mathematics -> Combinatorics`
|
|
- `Mathematics -> Counting`: Count an attribute of input e.g. a task to count number of vowels in a given word
|
|
- `Mathematics -> Geometry`
|
|
- `Mathematics -> Statistics`
|
|
- `Multihop Reasoning`
|
|
- `Numerical Reasoning`
|
|
- `Numerical Reasoning -> Numerical Commonsense Reasoning`: Tasks which requires numerical commonsense knowledge e.g. a car has 4 wheels.
|
|
- `Planning`: Tasks which need some sort of planning e.g. how to go to Hawaii?
|
|
- `Quantitative Reasoning`
|
|
- `Reasoning on Actions`
|
|
- `Reasoning on Numbers`: When inputs are numbers, e.g. finding the maximum of a list
|
|
- `Reasoning on Objects`
|
|
- `Reasoning on Social Interactions`
|
|
- `Reasoning on Strings`
|
|
- `Reasoning with Symbols`
|
|
- `Relational Reasoning`
|
|
- `Scientific Reasoning`
|
|
- `Temporal Reasoning`
|
|
- `Textual Entailment`
|
|
- `Textual Entailment -> Abductive Reasoning`
|
|
- `Textual Entailment -> Analogical Reasoning`
|
|
- `Textual Entailment -> Deductive Reasoning`
|
|
- `Textual Entailment -> Inductive Reasoning`
|
|
|
|
## Domain
|
|
|
|
* `Accounting`
|
|
* `Animals`
|
|
* `Anthropology`
|
|
* `Architecture`
|
|
* `Art`
|
|
* `Astronomy`
|
|
* `Biology`
|
|
* `Biology -> Anatomy`
|
|
* `Biology -> Bioinformatics`
|
|
* `Biology -> Clinical Knowledge`
|
|
* `Biology -> Human Biology`
|
|
* `Biology -> Virology`
|
|
* `Books`
|
|
* `Business Ethics`
|
|
* `Captions`
|
|
* `Captions -> Image Captions`
|
|
* `Captions -> Video Captions`
|
|
* `Chemistry`
|
|
* `Code`
|
|
* `Code -> Language`
|
|
* `Code -> Language -> Python`
|
|
* `Code -> Language -> SQL`
|
|
* `Code -> Repo`
|
|
* `Code -> Repo -> Github`
|
|
* `Code -> Repo -> Stack Overflow`
|
|
* `Commonsense`
|
|
* `Commonsense -> Concepts and Relations`
|
|
* `Commonsense -> Concepts and Relations -> Physical Commonsense`: a context involving two physical objects with contrasting properties, usage, locations, etc.
|
|
* `Commonsense -> Concepts and Relations -> Social Commonsense`: a situation involving two people with contrasting attributes, emotions, social roles, etc.
|
|
* `Commonsense -> Concepts and Relations -> Spatial Commonsense`
|
|
* `Commonsense -> Stories`
|
|
* `Computer Science`
|
|
* `Computer Science -> Computer Security`
|
|
* `Computer Science -> Machine Learning`
|
|
* `Conference`
|
|
* `Countries`
|
|
* `Debatepedia`
|
|
* `Dialogue`
|
|
* `Econometrics`
|
|
* `Economics`
|
|
* `Economics -> Macroeconomics`
|
|
* `Economics -> Microeconomics`
|
|
* `Electrical Engineering`
|
|
* `English Exams`
|
|
* `Fiction`
|
|
* `Food`
|
|
* `Formal Fallacy`
|
|
* `Game`
|
|
* `Game -> Card Game`
|
|
* `Geography`
|
|
* `Global Facts`
|
|
* `Government and Politics`
|
|
* `Healthcare`
|
|
* `History`
|
|
* `History -> 9/11 Reports`
|
|
* `History -> European History`
|
|
* `Human Race`
|
|
* `Human Sexuality`
|
|
* `International Law`
|
|
* `Jurisprudence`
|
|
* `Justice`
|
|
* `Knowledge Base`
|
|
* `Knowledge Base -> Freebase`
|
|
* `Knowledge Base -> Wikidata`
|
|
* `Law`
|
|
* `Linguistics`
|
|
* `Literature`
|
|
* `Logic`
|
|
* `Logic -> Formal logic`
|
|
* `Logic -> Propositional Logic`
|
|
* `Management`
|
|
* `Marketing`
|
|
* `Mathematics`
|
|
* `Medical Genetics`
|
|
* `Medicine`
|
|
* `Miscellaneous`
|
|
* `Moral Scenarios`
|
|
* `Movies`
|
|
* `Music`
|
|
* `Narrative`
|
|
* `Narrative -> Everyday Events`
|
|
* `Natural Science`
|
|
* `Natural Science -> School Science Textbooks`
|
|
* `News`
|
|
* `Nutrition`
|
|
* `Personal Narratives`
|
|
* `Philosophy`
|
|
* `Physics`
|
|
* `Pop Culture`
|
|
* `Prehistory`
|
|
* `Professions`
|
|
* `Psychology`
|
|
* `Public Places`
|
|
* `Public Places -> Restaurants`
|
|
* `Public Relations`
|
|
* `Reviews`
|
|
* `Reviews -> Books`
|
|
* `Reviews -> Electronics and Grocery`
|
|
* `Reviews -> Food`
|
|
* `Reviews -> Movies`
|
|
* `Reviews -> Music`
|
|
* `Reviews -> Restaurants`
|
|
* `Reviews -> TripAdvisor`
|
|
* `Scientific Research Papers`
|
|
* `Security: Environmental Security`
|
|
* `Security: National Security`
|
|
* `Social Media`
|
|
* `Social Media -> Reddit`
|
|
* `Social Media -> Text Message`
|
|
* `Social Media -> Twitter`
|
|
* `Sociology`
|
|
* `Sports`
|
|
* `Sports -> NFL`
|
|
* `Statistics`
|
|
* `Stereotypes`
|
|
* `Story`
|
|
* `TED Talks`
|
|
* `US Foreign Policy`
|
|
* `Web`
|
|
* `Wikipedia`
|
|
* `World Religions`
|
|
|
|
## Language
|
|
|
|
- https://en.wikipedia.org/wiki/List_of_ISO_639-1_codes: ISO language name column
|