Extinction is a behavioral phenomenon observed in both operantly conditioned and classically conditioned behavior, which manifests itself by fading of non-reinforced conditioned response over time. When operant behavior that has been previously reinforced no longer produces reinforcing consequences, the behavior gradually returns to operant levels (to the frequency of the behavior previous to learning, which may or may not be zero)[1].[2] In classical conditioning, when a conditioned stimulus is presented alone, so that it no longer predicts the coming of the unconditioned stimulus, conditioned responding gradually stops. For example, after Pavlov's dog was conditioned to salivate at the sound of a metronome, it eventually stopped salivating to the metronome after the metronome had been sounded repeatedly but no food came. Many anxiety disorders such as post-traumatic stress disorder are believed to reflect, at least in part, a failure to extinguish conditioned fear.[3]
Theories
The dominant account of extinction involves associative models. However, there is debate over whether extinction involves simply "unlearning" the unconditional stimulus (US) – Conditional stimulus (CS) association (e.g., the Rescorla–Wagner account) or, alternatively, a "new learning" of an inhibitory association that masks the original excitatory association (e.g., Konorski, Pearce and Hall account). A third account concerns non-associative mechanisms such as habituation, modulation and response fatigue. Myers & Davis review fear extinction in rodents and suggested that multiple mechanisms may be at work depending on the timing and circumstances in which the extinction occurs.[4]
Given the competing views and difficult observations for the various accounts researchers have turned to investigations at the cellular level (most often in rodents) to tease apart the specific brain mechanisms of extinction, in particular the role of the brain structures (amygdala, hippocampus, the prefrontal cortex), and specific neurotransmitter systems (e.g., GABA, NMDA).[4] A recent study in rodents by Amano, Unal and Paré published in Nature Neuroscience found that extinction of a conditioned fear response is correlated with synaptic inhibition in the fear output neurons of the central amygdala that project to the periaqueductal gray that controls freezing behavior. They infer that inhibition derives from the ventromedial prefrontal cortex and suggest promising targets at the cellular level for new treatments of anxiety.[5]
Classical conditioning
Learning extinction can also occur in a classical conditioning paradigm. In this model, a neutral cue or context can come to elicit a conditioned response when it is paired with an unconditioned stimulus. An unconditioned stimulus is one that naturally and automatically triggers a certain behavioral response. A certain stimulus or environment can become a conditioned cue or a conditioned context, respectively, when paired with an unconditioned stimulus. An example of this process is a fear conditioning paradigm using a mouse. In this instance, a tone paired with a mild footshock can become a conditioned cue, eliciting a fear response when presented alone in the future. In the same way, the context in which a footshock is received such as a chamber with certain dimensions and a certain odor can elicit the same fear response when the mouse is placed back in that chamber in the absence of the footshock.
In this paradigm, extinction occurs when the animal is re-exposed to the conditioned cue or conditioned context in the absence of the unconditioned stimulus. As the animal learns that the cue or context no longer predicts the coming of the unconditioned stimulus, conditioned responding gradually decreases, or extinguishes.
Operant conditioning
In the operant conditioning paradigm, extinction refers to the process of no longer providing the reinforcement that has been maintaining a behavior. Operant extinction differs from forgetting in that the latter refers to a decrease in the strength of a behavior over time when it has not been emitted.[6] For example, a child who climbs under his desk, a response which has been reinforced by attention, is subsequently ignored until the attention-seeking behavior no longer occurs. In his autobiography, B. F. Skinner noted how he accidentally discovered the extinction of an operant response due to the malfunction of his laboratory equipment:
My first extinction curve showed up by accident. A rat was pressing the lever in an experiment on satiation when the pellet dispenser jammed. I was not there at the time, and when I returned I found a beautiful curve. The rat had gone on pressing although no pellets were received. ... The change was more orderly than the extinction of a salivary reflex in Pavlov's setting, and I was terribly excited. It was a Friday afternoon and there was no one in the laboratory whom I could tell. All that weekend I crossed streets with particular care and avoided all unnecessary risks to protect my discovery from loss through my accidental death.[7]
When the extinction of a response has occurred, the discriminative stimulus is then known as an extinction stimulus (SΔ or S-delta). When an S-delta is present, the reinforcing consequence which characteristically follows a behavior does not occur. This is the opposite of a discriminative stimulus, which is a signal that reinforcement will occur. For instance, in an operant conditioning chamber, if food pellets are only delivered when a response is emitted in the presence of a green light, the green light is a discriminative stimulus. If when a red light is present. food will not be delivered, then the red light is an extinction stimulus. (Food is used here as an example of a reinforcer.) However, some make the distinction between extinction stimuli and "S-Delta" due to the behavior not having a reinforcement history, i.e. in an array of three items (phone, pen, paper) "Which one is the phone" the "pen" and "paper" will not produce a response in the teacher, but is not technically extinction on the first trial due to selecting "pen" or "paper", missing a reinforcement history. This still would be considered as S-Delta.
Successful extinction procedures
In order for extinction to work effectively, it must be done consistently. Extinction is considered successful when responding in the presence of an extinction stimulus (a red light or a teacher not giving a bad student attention, for instance) is zero. When a behavior reappears again after it has gone through extinction, it is called spontaneous recovery. It (extinction) is the result of challenging behavior(s) no longer occurring without the need for reinforcement. If there is a relapse and reinforcements are given, the problem behavior will return. Extinction can be a long process; therefore, it requires that the facilitator of the procedure be completely invested from beginning to end in order for the outcome to be successful.[8] The fewer challenging behaviors observed after extinction will most likely produce a less significant spontaneous recovery.[9] While working towards extinction there are different distributions or schedules of when to administer reinforcements. Some people may use an intermittent reinforcement schedule that include: fixed ratio, variable ratio, fixed interval and variable interval. Another option is to use a continuous reinforcement. Schedules can be both fixed and variable and also the number of reinforcements given during each interval can vary.[10]
Extinction procedures in the classroom
A positive classroom environment wields better results in learning growth. Therefore, in order for children to be successful in the classroom, their environment should be free of problem behaviors that can cause distractions.[11] The classroom should be a place that offers consistency, structure, and stability, where the student feels empowered, supported and safe. When problem behaviors occur, learning opportunities decrease.[12] Problem behaviors in the classroom that would benefit from extinction may include off-task behaviors, blurting, yelling, interrupting and use of inappropriate language.[13] The use of extinction has been used primarily when the problem behaviors interfered with successful classroom outcomes.[14] While other methods have been used in conjunction with extinction, positive outcomes are not likely when extinction is not used in behavior interventions.[13]
Burst
While extinction, when implemented consistently over time, results in the eventual decrease of the undesired behavior, in the short term the subject might exhibit what is called an extinction burst. An extinction burst will often occur when the extinction procedure has just begun. This usually consists of a sudden and temporary increase in the response's frequency, followed by the eventual decline and extinction of the behavior targeted for elimination. Novel behavior, or emotional responses or aggressive behavior, may also occur.[2]
For example, a pigeon has been reinforced to peck an electronic button. During its training history, every time the pigeon pecked the button, it will have received a small amount of bird seed as a reinforcer. Thus, whenever the bird is hungry, it will peck the button to receive food. However, if the button were to be turned off, the hungry pigeon will first try pecking the button just as it has in the past. When no food is forthcoming, the bird will likely try repeatedly. After a period of frantic activity, in which their pecking behavior yields no result, the pigeon's pecking will decrease in frequency.
Although not explained by reinforcement theory, the extinction burst can be understood using control theory. In perceptual control theory, the degree of output involved in any action is proportional to the discrepancy between the reference value (desired rate of reward in the operant paradigm) and the current input. Thus, when reward is removed, the discrepancy increases, and the output is increased. In the long term, 'reorganisation', the learning algorithm of control theory, would adapt the control system such that output is reduced.
The evolutionary advantage of this extinction burst is clear. In a natural environment, an animal that persists in a learned behavior, despite not resulting in immediate reinforcement, might still have a chance of producing reinforcing consequences if the animal tries again. This animal would be at an advantage over another animal that gives up too easily.
Despite the name, however, not every explosive reaction to adverse stimuli subsides to extinction. Indeed, a small minority of individuals persist in their reaction indefinitely.
Extinction-induced variability
Extinction-induced variability serves an adaptive role similar to the extinction burst. When extinction begins, subjects can exhibit variations in response topography (the movements involved in the response). Response topography is always somewhat variable due to differences in environment or idiosyncratic causes but normally a subject's history of reinforcement keeps slight variations stable by maintaining successful variations over less successful variations. Extinction can increase these variations significantly as the subject attempts to acquire the reinforcement that previous behaviors produced. If a person attempts to open a door by turning the knob, but is unsuccessful, they may next try jiggling the knob, pushing on the frame, knocking on the door or other behaviors to get the door to open. Extinction-induced variability can be used in shaping to reduce problematic behaviors by reinforcing desirable behaviors produced by extinction-induced variability.
Children with Autism Spectrum Disorder (ASD) are known to have restricted or repetitive behaviors that can cause problems when trying to function in day-to-day activities.[15] Extinction is used as an intervention to help with problem behaviors.[16] Some problem behaviors may include but are not limited to, self-injurious behaviors, aggression, tantrums, problems with sleep, and making choices.[17] Ignoring certain self-injurious behaviors can lead to the extinction of said behaviors in children with ASD.[18] Escape Extinction (EE) is commonly used in instances when having to make choices causes problem behavior.[19] An example could be having to choose between mint or strawberry flavored toothpaste when brushing your teeth. Those would be the only two options available. When implementing EE, the interventionist will use physical and verbal prompting to help the subject make a choice.[19]
Anxiety
Fear extinction is the fundamental principle behind exposure therapy, a common treatment for anxiety disorders. In this process, the conditioned fear responses diminish progressively over time, when the previously conditioned stimulus is presented without being paired with the unconditioned stimulus.[20] To understand the brain changes during this, a task-functional Magnetic Resonance Imaging (fMRI) can be performed. Moreover, Positron Emission Tomography (PET) can be used to quantify endogenous dopamine release. Dopamine antagonists like [11C] raclopride and [18F] fallypride can be used to study D2/D3 dopamine receptor binding potential in the brain. [11C] Raclopride is popular in studies focusing on striatal dopamine activity[21] and ease of use considering a shorter half-life (about 20 minutes). On the other hand, [18F] fallypride is best for studying extrastriatal[22] dopamine binding potential[23] but has a half-life of approximately 110 minutes. Additionally, simultaneous PET and fMRI allow researchers to capture both dopamine binding potential and blood oxygen level-dependent (BOLD) signals during the task. Recent studies highlight the critical role of dorsolateral and ventromedial prefrontal cortex regions (vmPFC), together with other areas like the anterior insula, amygdala, and hippocampus in facilitating fear extinction processes.[24]
Neurobiology
Glutamate
Glutamate is a neurotransmitter that has been extensively implicated in the neural basis of learning.[25] D-Cycloserine (DCS) is a partial agonist for the glutamate receptor NMDA at the glycine site, and has been trialed as an adjunct to conventional exposure-based treatments based on the principle of cue extinction.
A role for glutamate has also been identified in the extinction of a cocaine-associated environmental stimulus through testing in rats. Specifically, the metabotropic glutamate 5 receptor (mGlu5) is important for the extinction of a cocaine-associated context[26] and a cocaine-associated cue.[27]
Dopamine
Dopamine is another neurotransmitter implicated in learning extinction across both appetitive and aversive domains.[28] Dopamine signaling has been implicated in the extinction of conditioned fear[29][30][31][32][33] and the extinction of drug-related learning[34][35]
Circuitry
The brain region most extensively implicated in learning extinction is the infralimbic cortex (IL) of the medial prefrontal cortex (mPFC)[36] The IL is important for the extinction of reward- and fear-associated behaviors, while the amygdala has been strongly implicated in the extinction of conditioned fear.[4] The posterior cingulate cortex (PCC) and temporoparietal junction (TPJ) have also been identified as regions that may be associated with impaired extinction in adolescents.[37]
Across development
There is a strong body of evidence to suggest that extinction alters across development.[38][39] That is, learning extinction may differ during infancy, childhood, adolescence and adulthood. During infancy and childhood, learning extinction is especially persistent, which some have interpreted as erasure of the original CS-US association,[40][41][42] but this remains contentious. In contrast, during adolescence and adulthood extinction is less persistent, which is interpreted as new learning of a CS-no US association that exists in tandem and opposition to the original CS-US memory.[43][44]
^Kim, Jee Hyun; Perry, Christina; Luikinga, Sophia; Zbukvic, Isabel; Brown, Robyn M.; Lawrence, Andrew J. (2015-05-01). "Extinction of a cocaine-taking context that protects against drug-primed reinstatement is dependent on the metabotropic glutamate 5 receptor". Addiction Biology. 20 (3): 482–489. doi:10.1111/adb.12142. ISSN1369-1600. PMID24712397. S2CID11626810.
^Haaker, Jan; Lonsdorf, Tina B.; Kalisch, Raffael (2015-10-01). "Effects of post-extinction l-DOPA administration on the spontaneous recovery and reinstatement of fear in a human fMRI study". European Neuropsychopharmacology. 25 (10): 1544–1555. doi:10.1016/j.euroneuro.2015.07.016. ISSN1873-7862. PMID26238968. S2CID6242752.
^Madsen, Heather B.; Guerin, Alexandre A.; Kim, Jee Hyun (2017). "Investigating the role of dopamine receptor- and parvalbumin-expressing cells in extinction of conditioned fear". Neurobiology of Learning and Memory. 145: 7–17. doi:10.1016/j.nlm.2017.08.009. PMID28842281. S2CID26875742.
^Kim, Jee Hyun; Richardson, Rick (2007). "A developmental dissociation in reinstatement of an extinguished fear response in rats". Neurobiology of Learning and Memory. 88 (1): 48–57. doi:10.1016/j.nlm.2007.03.004. PMID17459734. S2CID19611691.
^Kim, Jee Hyun; Ganella, Despina E. (2015). "A Review of Preclinical Studies to Understand Fear During Adolescence". Australian Psychologist. 50 (1): 25–31. doi:10.1111/ap.12066. S2CID142760996.
Cet article est une ébauche concernant la Suisse et la police ou la gendarmerie. Vous pouvez partager vos connaissances en l’améliorant (comment ?) selon les recommandations des projets correspondants. Voiture de la police cantonale genevoise. En Suisse, les polices cantonales sont les principales forces de polices du pays. Histoire Après l'acte de Médiation, la majorité des cantons, répondant aux appels de la Diète, mirent sur pied des corps cantonaux de gendarmes en 1803 et 18...
عزلة مساهر مور - عزلة - تقسيم إداري البلد اليمن[1] المحافظة محافظة حجة المديرية مديرية الجميمة خصائص جغرافية إحداثيات 15°59′15″N 43°33′40″E / 15.98755°N 43.56114°E / 15.98755; 43.56114 الارتفاع 809 متر السكان التعداد السكاني 2004 السكان 7٬381 • الذكور 4٬036 ...
Dieser Artikel behandelt den Designwettbewerb iF Award. Für den australischen Filmpreis siehe Inside Film Award. Logo des Forums Die Auszeichnung Industrie Forum Design ist ein Preis für Leistungen im Bereich Design. Seit 1954 wird die Auszeichnung jährlich für Leistungen im Bereich der Produktgestaltung verliehen. Verleiher ist heute der Verein iF Industrie Forum Design e. V., der 2001 in Hannover das Unternehmen iF International Forum Design GmbH gegründet hat, das den jährlichen...
Shire of Perenjori Local Government Area van Australië Locatie van Shire of Perenjori in West-Australië Situering Staat West-Australië Hoofdplaats Perenjori Coördinaten 29°26'35ZB, 116°17'6OL Algemene informatie Oppervlakte 8.611[1] km² Inwoners 629 (2021)[2] Overig Website (en) Shire of Perenjori Portaal Australië Shire of Perenjori is een lokaal bestuursgebied (LGA) in de regio Mid West in West-Australië. Shire of Perenjori telde 629 inwoners in 2021. D...
Brunei Kapitän letzte Teilnahme 2008 Aktuelles ITF-Ranking letzte Teilnahme 2008 Statistik Erste Teilnahme 1994 Davis-Cup-Teilnahmen 13 davon in Weltgruppe 0 Bestes Ergebnis 9. in Asien/Ozeanien Zone Gruppe III (1994) Ewige Bilanz 5:58 Erfolgreichste Spieler Meiste Siege gesamt Ismasufian Ibrahim (13) Meiste Einzelsiege Ismasufian Ibrahim (6) Meiste Doppelsiege Ismasufian Ibrahim (7) Bestes Doppel Pheng-Chai Chua /Ismasufian Ibrahim (2) Meiste Teilnahmen Ismasufian Ibrahim (35) Meiste Jahre ...
Supertaça de Angola (handball)Current season, competition or edition: 2017 Angola Handball Super CupSportHandballFounded2007ContinentCAHB (Africa)Most recentchampion(s)Interclube (M) (2017)Petro de Luanda (W) (2017)Most titlesInterclube (M) (4 titles)Petro de Luanda (W) (8 titles) The Angolan Handball SuperCup aka Supertaça Francisco de Almeida is an annual handball competition between the winners of the previous year's league champion and cup. In case the same team happens to win both the ...
Position géographique des 100 universités les plus réputées selon le Times Higher Education World University Rankings. Un classement académique international sélectionne des institutions universitaires selon un nombre restreint d’indicateurs quantitatifs pour établir une hiérarchie selon le modèle d’une ligue des champions. Ils soulèvent des calculs sophistiqués pour tenir compte d’une réalité complexe et diversifiée. Il y a deux types de classements : les classements...
Marco Minnemann (Aarhus, 2016)Marco Minnemann (* 24. Dezember 1970 in Hannover) ist ein deutscher Schlagzeuger. Inhaltsverzeichnis 1 Leben 2 Diskografie 3 Videoalben 4 Weblinks 5 Einzelnachweise Leben Minnemann kam mit 19 Jahren nach München, wo er 1992 Schlagzeuger der Crossover-Band Freaky Fukin Weirdoz wurde. Nebenbei gründete er mit der Sängerin Artemis Gounaki das Progressive-Rock-Projekt Illegal Aliens. 1997 wechselte er zu den H-Blockx, bei denen er bis 1999 blieb. In den folgenden ...
This biography of a living person needs additional citations for verification. Please help by adding reliable sources. Contentious material about living persons that is unsourced or poorly sourced must be removed immediately from the article and its talk page, especially if potentially libelous.Find sources: Tiken Jah Fakoly – news · newspapers · books · scholar · JSTOR (February 2008) (Learn how and when to remove this template message) Tiken Jah Fako...
International border Eritrea–Sudan borderMap of Eritrea, with Sudan to the westCharacteristicsEntities Eritrea, SudanLength686 km (426 mi)HistoryEstablished24 May 1993Eritrean War of Independence won in 1991, Eritrea officially declared a nation in 1993 after a referendum making Ethiopia landlocked.Current shape24 May 1991 [a]Eritrean–Ethiopian border conflict The Eritrea–Sudan border (Tigrinya: ዶብ ኤርትራ-ሱዳን; Italian: Confine Eritrea-Su...
Broad, thin muscle group, situated on either side of the pelvis This article may require cleanup to meet Wikipedia's quality standards. The specific problem is: Content under Pubococcygeus and Puborectalis sections should be integrated with the rest of the article. Relevant discussion may be found on the talk page. Please help improve this article if you can. (July 2020) (Learn how and when to remove this template message) Levator aniLeft Levator ani seen from within.Coronal section through t...
2014 film American HeistCanadian theatrical release posterDirected bySarik AndreasyanWritten byRaul InglisBased onThe Great St. Louis Bank Robberyby Charles GuggenheimProduced by Tove Christensen Georgy Malkov Sarik Andreasyan Gevond Andreasyn Vladimir Poliakov Starring Hayden Christensen Adrien Brody Jordana Brewster Tory Kittles Akon CinematographyAntonio CalvacheEdited by Kirill Kozlov Kiran Pallegadda Music by Roman Vishnevsky Alim Zairov Akon (original music tracks) Productioncompanies G...
Bài này viết về Vườn quốc gia tại Brasil. Đối với vườn quốc gia tại Argentina, xem Vườn quốc gia Iguazú. Vườn quốc gia IguaçuIUCN loại II (Vườn quốc gia)Thác IguazuVị tríParaná, BrasilTọa độ25°41′N 54°26′T / 25,683°N 54,433°T / -25.683; -54.433Diện tích1.700 km2 (660 dặm vuông Anh)Thành lập10 tháng 1 năm 1939 Di sản thế giới UNESCOLoạiThiên nhiênTiêu chuẩnvii, xĐ...
Roberto Rossellini Rossellini en 1951Información personalNombre de nacimiento Roberto Gastone Zeffiro RosselliniNacimiento 8 de mayo de 1906 Roma, ItaliaFallecimiento 3 de junio de 1977 (71 años) Roma, ItaliaCausa de muerte Infarto agudo de miocardio Sepultura Cementerio comunal monumental Campo Verano Nacionalidad Italiana (1946-1977)FamiliaPadres Angelico Giuseppe Elettra BellanCónyuge Assia NorisMarcella De Marchis (matr. 1936; div. 1950)Ingrid Bergman (ma...
Kijivu and Tatu The Revealed: A slightly different reality show is a nature documentary webcast, following the lives of western lowland gorillas living in Prague Zoo, Czech Republic. It is a joint project of Czech Radio, Prague Zoo and telecommunication company Visual Connection. Presented as a parody of human reality television, the objective of the broadcast is to show the behaviour of gorillas living in captivity, and the gorillas have been seen eating, sleeping, socialising, solving brain...
New York City SubwayAtas: Kereta nomor 4 terdiri dari rangkaian KRL R142 memasuki stasiun Fordham Road.Bawah: Kereta M terdiri dari rangkaian KRL R160A memasuki stasiun Hewes Street.InfoWilayahNew York CityJenisAngkutan cepatJumlah jalur24Jumlah stasiun468Penumpang harian5.366.336 (akhir pekan, 2010)5.156.913 (hari kerja, 2010)[1]Situs webwww.mta.info/nyctOperasiDimulaibagian kereta bawah tanah pertama: 27 Oktober 1904 operasi kereta jembatan pertama: 3 Juli 1868 operasi kereta darat ...
Automotive magazine This article has multiple issues. Please help improve it or discuss these issues on the talk page. (Learn how and when to remove these template messages) This article is an orphan, as no other articles link to it. Please introduce links to this page from related articles; try the Find link tool for suggestions. (December 2015) This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced materi...
Kim Jung-woo Kim Jung-Woo bermain di Asian Games 2010Informasi pribadiTanggal lahir 9 Mei 1982 (umur 41)Tempat lahir Korea SelatanPosisi bermain GelandangKarier senior*Tahun Tim Tampil (Gol)2006-2007 Nagoya Grampus Eight * Penampilan dan gol di klub senior hanya dihitung dari liga domestik Kim Jung-woo (lahir 9 Mei 1982) adalah pemain sepak bola asal Korea Selatan. Karier Kim Jung-woo pernah bermain untuk Nagoya Grampus Eight. Pranala luar (Jepang) Profil dan statistik di situs web resmi...
2022 single by YG ToxicSingle by YGfrom the album I Got Issues ReleasedAugust 12, 2022Length3:33Label4HunnidDef JamSongwriter(s)Keenon JacksonMary J. BligeSean CombsJean-Claude OlivierCurtis MayfieldArlene DelValleLarry SandersGil AskeySamuel AhanaProducer(s)DJ SwishMike CrookReece BeatsLarry JayyYG singles chronology Run (2022) Toxic (2022) Sport Mode (2022) Music videoToxic on YouTube Toxic is a song by American rapper YG, released on August 12, 2022 as the third single from his sixth studi...