Ron,
When I say that pilots are no more or less reliable than other witnesses I am speaking about the group as a whole. Certainly pilots are not likely to be fooled by Venus, its a simple matter to sort that one out. I have seen Venus looking like a second sunrise but a quick glance at an astronomical almanac can resolve that directly.
The real point is that some pilots have the education and background to be able to bring analytical skills to bear on their observation and determine if it is unusual or not. Others do not. Add to that personal beliefs, personal experience and temperament and you will encounter a full spectrum of responses, conclusions and attitudes.
The same thing applies to ground observers. Some people have the skillset and mindset to engage an examination of their experience and come to some fairly accurate conclusions. Others yell "Aliens" and either run like hell or grab a flashlight and start signaling. Then they write a book on the "Reptilan Influences on Western Civilization" and start doing conferences and seminars. Pilots have followed this course as well.
It is more likely that a pilot will misidentify something as unusual if its at a distance than when it involves aviation safety issues like perceived NMACS, dynamic trajectories, etc...
It is interesting that pilots, regardless of their educational background or flight experience/flight hours, continue to report the same kinds of observation since before the 1930s and that the observations involve the same descriptions over decades....
I can accept that honesty and critical thinking must follow an observation regardless the observer or the results are dubious at best. I can also accept that distance and complex trajectories can fool even those with good and honest intentions. I would also agree with one of your other posts that a visual sighting gains credibility when witnessed by multiple observers and/or backed up by radar.
To be honest I am somewhat of an optimist. I have this image of the smart, honest, observant, and unshakable pilot in my head. (BTW, that is not an ego projection of how I see myself. Rather an image from childhood to aspire to.) Though, every month I open Aviation Safety and see incidents and accidents attributed to simple mistakes like running out of gas. I may need to re-evaluate my opinion on this.
Can I ask a few questions from your research? I want to be more informed than I am right now. Perhaps you have some of these answers. If not thats OK, I am just curious.
1 -- Of pilot reports what percentage of sighting reports come from Military, Commercial, and GA pilots? Specifically, in what capacity were they operating when the sighting occurred?
2 -- Has any one capacity been shown to be more reliable than another?
3 -- Do you know how often on average ATC spots traffic in non-military designated areas that have no transponder squawk?
4 -- If a military aircraft is in civilian ATC controlled airspace they are supposed to use a transponder squawk per FAA regulations. What measures are/can be taken for aircraft that violate that safety rule?
5 -- I have been told by a few older pilots and one controller that military aircraft are supposed to communicate their presence to ATC in controlled airspace like everyone else. How often is this procedure broken?
6 -- In reported sightings from pilots that are deemed unknown, are there distance, speed, size, and altitude tolerances that most fall into?
Also, I want to thank you for your continued contributions to the forum. I know I speak for many when I say your insights are very welcome.