#FIG 3.2 Landscape Center Inches Letter 100.00 Single -2 1200 2 6 1125 1275 10725 5475 6 1125 1275 10725 5475 6 6900 1875 7650 2625 4 0 0 50 0 0 24 0.0000 4 255 360 6900 2100 go\001 4 0 0 50 0 0 24 0.0000 4 255 735 6900 2520 nogo\001 -6 6 6900 2925 7650 3675 4 0 0 50 0 0 24 0.0000 4 255 360 6900 3150 go\001 4 0 0 50 0 0 24 0.0000 4 255 735 6900 3570 nogo\001 -6 6 6900 4050 7650 4800 4 0 0 50 0 0 24 0.0000 4 255 360 6900 4275 go\001 4 0 0 50 0 0 24 0.0000 4 255 735 6900 4695 nogo\001 -6 2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2 1 1 1.00 120.00 120.00 3225 1950 4350 1950 2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2 1 1 1.00 120.00 120.00 3525 3075 4350 3075 2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2 1 1 1.00 120.00 120.00 3525 4200 4350 4200 2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2 1 1 1.00 120.00 120.00 5475 1950 6825 1950 2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2 1 1 1.00 120.00 120.00 5475 1950 6825 2400 2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2 1 1 1.00 120.00 120.00 5475 3000 6825 3000 2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2 1 1 1.00 120.00 120.00 5475 3000 6825 3450 2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2 1 1 1.00 120.00 120.00 5475 4125 6825 4125 2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2 1 1 1.00 120.00 120.00 5475 4125 6825 4575 2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2 1 1 1.00 120.00 120.00 7350 1950 8400 1950 2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2 1 1 1.00 120.00 120.00 7650 3375 8400 3375 2 1 0 1 0 7 50 0 -1 0.000 0 0 -1 1 0 2 1 1 1.00 120.00 120.00 7350 4125 8400 4125 2 1 1 1 0 7 50 0 -1 4.000 0 0 -1 1 0 5 1 1 1.00 120.00 120.00 10350 2775 10725 2775 10725 1275 1125 1275 1575 1950 2 1 1 1 0 7 50 0 -1 4.000 0 0 -1 1 0 2 1 1 1.00 120.00 120.00 1125 1275 1575 3000 2 1 1 1 0 7 50 0 -1 4.000 0 0 -1 1 0 2 1 1 1.00 120.00 120.00 1125 1275 1575 4125 2 1 1 1 0 7 50 0 -1 4.000 0 0 -1 1 0 5 1 1 1.00 120.00 120.00 7725 4575 8325 4575 8325 5175 1500 5175 1650 4350 2 1 1 1 0 7 50 0 -1 4.000 0 0 -1 1 0 5 1 1 1.00 120.00 120.00 9450 4125 9675 4125 9675 5475 1200 5475 1575 3075 2 1 1 1 0 7 50 0 -1 4.000 0 0 -1 1 0 2 1 1 1.00 120.00 120.00 1200 5475 1575 2100 4 0 0 50 0 0 24 0.0000 4 255 1380 1725 2100 Srewmov\001 4 0 0 50 0 0 24 0.0000 4 255 1755 1725 4275 Snorewmov\001 4 0 0 50 0 0 24 0.0000 4 255 1755 1725 3150 Srewnomov\001 4 0 0 50 0 0 24 0.0000 4 330 960 4425 2100 trigger\001 4 0 0 50 0 0 24 0.0000 4 330 960 4425 3150 trigger\001 4 0 0 50 0 0 24 0.0000 4 330 960 4425 4275 trigger\001 4 0 0 50 0 0 24 0.0000 4 255 1005 8475 2100 reward\001 4 0 0 50 0 0 24 0.0000 4 255 900 8475 4275 sound\001 4 0 0 50 0 0 24 0.0000 4 255 1005 8475 3525 reward\001 4 0 0 50 0 0 160 0.0000 4 2040 1155 9375 3375 }\001 -6 -6 6 1125 9075 10125 9900 4 0 0 50 0 0 24 0.0000 4 255 8910 1125 9375 Buffers should be cleared between trials that do not end with\001 4 0 0 50 0 0 24 0.0000 4 330 8955 1125 9795 sound, to avoid the need for many randomized training trials.\001 -6 2 1 1 1 1 7 50 0 -1 4.000 0 0 -1 0 0 2 4500 1575 5175 4575 2 1 1 1 1 7 50 0 -1 4.000 0 0 -1 0 0 2 4500 4575 5250 1575 2 1 0 1 4 7 50 0 -1 0.000 0 0 -1 1 0 3 1 1 1.00 120.00 120.00 1575 7725 1275 7725 1275 7500 2 2 0 1 7 7 50 0 -1 0.000 0 0 -1 0 0 5 75 150 10875 150 10875 9975 75 9975 75 150 4 0 0 50 0 0 30 0.0000 4 405 5145 150 525 Wolfram Schultz (2000) task:\001 4 0 1 50 0 0 24 0.0000 4 330 5895 4125 5925 for simplicity, leave out the trigger stage\001 4 0 0 50 0 0 24 0.0000 4 330 3825 1200 6600 sound may be regarded as\001 4 0 0 50 0 0 24 0.0000 4 330 2415 1200 7020 a) a goal in itself\001 4 0 0 50 0 0 24 0.0000 4 330 6030 1200 7440 b) a state associated with paths to reward\001 4 0 4 50 0 0 24 0.0000 4 330 7980 1725 7875 this demonstrates minicolumn capabilities (and it may\001 4 0 4 50 0 0 24 0.0000 4 330 6540 1725 8295 not be necessary to include sound as a state)\001 4 0 4 50 0 0 24 0.0000 4 330 7830 1125 8850 Thus, there are 2 actions and 4 states (5 with sound).\001