An evolutionary model of reinforcer value
20
Citation
91
Reference
10
Related Paper
Citation Trend
Keywords:
Adaptive value
Value (mathematics)
Matching law
Maximization
Behavioural genetics
Adaptive value
Value (mathematics)
Matching law
Maximization
Behavioural genetics
Cite
Citations (20)
Matching law
Generality
Cite
Citations (60)
Pigeons on concurrent variable‐ratio variable‐ratio schedules usually, though not always, maximize reinforcements per response. When the ratios are equal, maximization implies no particular distribution of responses to the two alternatives. When the ratios are unequal, maximization calls for exclusive preference for the smaller ratio. Responding conformed to these requirements for maximizing, which are further shown to be consistent with the conception of reinforcement implicit in the matching law governing relative responding in concurrent interval schedules.
Maximization
Matching law
Cite
Citations (327)
Behavioural genetics
Animal Behavior
Adaptive value
Human evolutionary genetics
Quantitative Genetics
Cite
Citations (1)
During Phase I, three female human subjects pressed a button for monetary reinforcement in five variable-interval schedules specifying different frequencies of reinforcement. On alternate days, responding was also punished (by subtracting money) according to a variable-ratio 34 schedule. In the absence of punishment, response rates conformed to Herrnstein's equation for single variable-interval schedules. Punishment suppressed responding at all frequencies of reinforcement. This was reflected in a change in the values of both constants in Herrnstein's equation: the value of the theoretical maximum response-rate parameter was reduced, and the parameter describing the reinforcement frequency corresponding to the half-maximal response rate was elevated. During Phase II, the same five schedules (A) were in operation (without punishment), but in addition, a concurrent variable-interval schedule (B) of standard reinforcement frequency was introduced. On alternate days, responding in Component B was punished according to a variable-ratio 34 schedule. In the absence of punishment, absolute response rates conformed to equations proposed by Herrnstein to describe performance in concurrent schedules; the ratios of the response rates in the two components and the ratios of the times spent in the two components conformed to the Matching Law. When responding in Component B was punished, response rates in Component B were reduced and those in Component A were elevated, these changes being reflected in distortions of the matching relationship.
Matching law
Punishment (psychology)
Operant conditioning
Component (thermodynamics)
Cite
Citations (59)
Matching behavior is a phenomenon describing response rate ratios of an organism as a function of their associated reinforcer rate ratios. The generalized matching law (GML), its quantitative formulation, has been frequently found to explain over 80% of the variance in concurrent reinforcement schedules. However, a previous paper found by means of Monte Carlo simulations that matching behavior could be due to environmental constraints on behavior rather than a mere decision-making process. The purpose of the current study is to systemically investigate the influence of constraints induced by concurrent schedules of reinforcement. A Monte Carlo simulation was carried out. Results showed that the GML reached much better explained variances with real (and artificial) organisms than the current simulated results. Thus, a learning process seems partly necessary to generate matching behavior. According to the current findings, concurrent reinforcement schedules clearly induced a quantitative dependency between behavior rates and reinforcer rates. The simulation demonstrates that matching behavior is not only a consequence of a behavioral (decision-making) process, but of environmental conditions also.
Matching law
Cite
Citations (7)
Matching law
Independence
Cite
Citations (32)
Reinforcement maximization by identifying and following switching rules that occurred on conFR/VI-10 sec. reinforcement schedules did not occur when the subject experienced conFR/VI-20 sec. reinforcement schedules. Exclusive preference for the schedule with the lower valued N on conFR-N/FR-N schedules occurred as predicted by both matching and maximization theories of operant choice behavior. Additional research is required to assess the reliability of the phenomenon observed and factors upon which its occurrence may depend.
Maximization
Matching law
Cite
Citations (2)
A single subject allocated behavior to several concurrent variable interval/fixed ratio reinforcement schedules and a series of fixed ratio schedules with no other alternative schedule present. The allocation of behavior to the real choices (concurrent schedules) and no choice (fixed ratio only) schedule situations conformed to those predicted by formal equations for maximization of reinforcements in each situation. The results suggest that, while matching may be a fundamental rule of behavioral choice in animals and people, there exist identifiable limitations to its applicability to human choice behavior. Humans with some training in economic income maximization are likely to maximize rather than match in concurrent choice situations.
Maximization
Matching law
Cite
Citations (48)
Behavioural genetics
Animal Behavior
Adaptive value
Human evolutionary genetics
Quantitative Genetics
Cite
Citations (0)