I guess we'll have to agree to disagree. There's a mountain of data and a working hypothesis which at this time has yet to be completely overthrown by a reasonable alternative explanation (visitors from other worlds) and investigators continually give the lie to that last statement. This statement is just wrong on so many levels
There is an unjustified hypothesis that aliens visit from other worlds, yes. It is about as coherent, and has as much verifiable evidence, as the hypothesis that there is an invisible, sentient, male who lives in the sky and controls the universe. What you call evidence, science doesn't. You're playing a different game altogether, but using the same name.
The difference in our views is that your view does nothing to try to explain the source of the phenomenon, only that the phenomenon actually occurred and wasn't something imagined by the witnesse(s). In fact it looks as though your investigative method would arrive at a dead-end once several witnesses said they saw the cigar burning the circle into the ground and that other laboratory technicians happened to get optical and electromagnetic readings from the device (i.e. a video, along with several other trace readings showing that a real object was there) -- based on your understanding, even the best laid and accomplished plans of the observers and witnesse(s) establishing without a doubt the event occurred and had a more or less complete description, would still lack in any kind of theoretical framework for which to develop a hypothesis on the source.
The only hypothesis that would be possible would be just whether or not the event took place, if you're going to avoid assumptions, invented parameters or biased research. I don't see how any other hypothesis could really come about. You can't know any more about the event.
Several identical events would have to take place, all with the same field and lab results, before someone could say there was a legitimate pattern. This is the other big problem with the paranormal/ufo field; I have read many, many reports and pretty much never do two reports from separate events resemble one another beyond the superficial or sociologically recognized mythological constructs (which, even then, still manage to contain blaring differences). It generally requires stretching the information from two or more cases, and unjustly filling in blanks with speculative assumption, to tie most cases together. Even then, the original information from the cases generally remains unverified by any reasonable scientific standard.
If I were to do a field investigation, I would be thrilled if I could just somehow verify that something actually happened. It would be further than pretty much any report has ever gotten. You're trying to move to the next step (classifying a phenomenon) without completing the first one (verifying that a phenomenon occurred). That's the scientific community's problem with this field.
You seem have a different idea of "known" here, and I must admit it puzzles me as well so I am just going to lay them out
(1) "Known" means everything stated by the witness actually occurred and was verified by some other witness or perhaps data collected by a group of astronomers or scientists who happened to have all their data gathering instruments honed in on the site.
(2) "Known" means everything stated by the witness actually occurred and is known to fit in a class of observations that have no scientific explanation
(3) "Known" means everything stated by the witness actually occurred and is a known phenomena X that has been mistakenly identified as some fictional Y.
(4) "Known" means everything stated by the witness....is a known example of an extra-terrestrial entity (sub interdimensional entity, ultra-terrestrial entity, ghost entity, massive collective psychic force generated by many humans, etc) riding in a known vehicle for which that entity would be expected to use.
I guess we have just reached some kind of misunderstanding. "Known" means that which can be verified empirically and otherwise academically.
Empirical, in the scientific arena, doesn't mean "something someone observed with the senses." It means that it is something that can be observed, and replicated to be observed by others, in a controlled
or field study environment (though, most field study research ends up being scrutinized in a lab). Unless the spaceship or light phenomenon or whatever is alright with returning on command for study, that part of a report can never be empirically verified. Given the human mind's
need to fill in data for unknown observations, it's also the least compelling part of a report.
The only thing knowable, for certain, is that someone said something happened. So, your hypothesis begins with that as the parameter to be tested. The goal is to push the known beyond that to, "somebody said something happened and evidence suggests that it did/did not." Given the fact that most "evidence" can't be verified, in any way, or compared to any other verified (thus known) data, this step is generally impossible. Mass sightings can generally move into a position of confirmation of an event having taken place, but whether or not it was as described by witnesses is generally unable to be verified (especially if cross communications between witnesses could have reasonably taken place between the time of the event and the time of the investigation). All of this means that the hypothesis revolving around the report can't move in any direction as far as a truth value is concerned, so the truth value portion of the hypothesis, in regards to the narrative of the report being 100% accurate, remains "unknown."
That's why most scientific investigations into these types of things that have been conducted in the past landed on "inconclusive" as an explanation for a handful of reports. Most of the others were explained as misidentification of known phenomena.
I know a lot of you guys feel that science isn't the only way one can arrive at the understanding of a universal truth, and will reference the way the legal system handles things as an alternative. I'd ask you to consider this, though:
Let's say that the legal system recognized that there was a man, Mr. Ufo, who was routinely accused of crimes that he did not commit, as this was a sociologically recognized joke that people enjoyed playing, he was now a household name as far as crime goes, and it could get a few minutes in the paper or on TV. The majority of the cases brought against Mr. Ufo involve eyewitness testimony, yet the majority are also shown to be deliberately or mistakenly false. Almost 100% of these cases are even investigated at all based on eyewitness testimony, not due to the circumstantial discovery of a crime (the discovery of a murdered body, the discovery of a building that had been vandalized, etc). In none of Mr. Ufo's cases are elements of physical evidence beyond the extremely circumstantial ever presented before the court, nor are these rare pieces of circumstantial evidence ever verified in any way by a forensics team. In the extremely rare cases where Mr. Ufo isn't proven to be outright innocent, the small amount of unverified, circumstantial evidence that is being used to build the case against him is never enough to remove doubt or even point directly at him. Due to all of this, Mr. Ufo is a very famous individual who has become to go-to name everyone thinks of when they see what they believe to be a crime being committed.
Do you think the legal system would really put a whole lot of weight into its review of eyewitness testimony in these cases, or would they increasingly demand that the physical evidence be verified beyond a shadow of doubt?
Now, this is
not why science doesn't care about eyewitness testimony, in and of itself. As I said, the reason for that is that eyewitness testimony can't be verified in a scientifically empirical way. This is just so you guys can think about how a lot of us feel about the situation when you bring up the legal system.