Experimental Design
The subjects of the experiment were all PCPs associated with the IPA who practiced in either the family practice or internal medicine specialties in an outpatient (ambulatory) setting. Subjects assigned to the treatment group all received an informational treatment: a letter containing historical average costs of six ophthalmology practices affiliated with the IPA, the ``treatment,'' ``prices,'' or ``cost report.'' Control group subjects did not receive anything. In order to maximize the experiment sample size, all of the IPA's PCPs who were active at the time of the treatment distribution were included if they satisfied minimal criteria: they must have had at least ten claims during each calendar month from August 2013 through January 2014, and made at least one patient referral to ophthalmology during that period. In the end, a total of 93 PCPs -- 35 internists and 58 family practitioners -- were included in the experiment. These physicians were typically organized into group practices. In total, there were 55 included practices, with 24 of them being internal medicine, 30 family practice, and one mixed specialty group.
To account for the organization of PCPs into practices, assignment into treatment and control groups took place at the practice level, so that either all PCPs in a practice were assigned to the treatment group, or none were.
During the experiment, the IPA collected data on PCP referrals as part of its normal operations. This data was generated by the PCPs' activities of seeing and treating patients as part of their usual medical practices in their regular offices. The IPA regularly collects all of this data, and all of the physicians are aware of this data collection. Moreover, none of the physicians were made aware that the distribution of the price information was related to an experiment, thereby minimizing any possible influence of the ``Hawthorne effect.''