It's not cool to not know what you're talking about.
-- Barrack Obama
Because if a theory is disproved, the people researching that theory are out of a job. They won't be researching it anymore, because it would have been disproven.
??? Wow! You really don't understand much about scientists, scholarly research,
falsifiability, peer review,
burden of proof, science and the
scientific method. That's a whole lot of "stuff" to not understand well, and yet expect to be taken seriously, much less to be taken as having enough intellectual integrity that one's comments should be given any attention at all, to say nothing of making the comments in the first place. It's fine not to know/understand something well and ask questions about it in an effort to understand it; it's totally irresponsible to make statements about that something while one is in that state of ignorance.
The job of a scientist/researcher is to determine whether something is so or is not so. They will retain their job regardless of whether they show a theor to be false, largely false, somewhat false, somewhat true, largely true, or true. They do not risk losing their jobs for doing any one of those things.
Scientists are at risk of losing their jobs for all the same qualitative reasons - slovenly or perfunctory performance -- any worker may lose their job. Additionally, scientists put their jobs, lo their whole careers, at risk if it's determined that they have
paltered,
prevaricated or boldly lied in their presentations of their research findings. Failing to produce original research is another thing that can get a scientist fired because all research scientists (PhDs of any sort, not just science PhDs) are tasked with doing must be original explorations of something; they must produce answers to questions for which no credible direct answer currently exists. That's what is meant by "contributing to the body of knowledge in a field." Obviously, some things they "figure out" are "big deals," and others are not such "big deals."
The
peer review process is the check/balance used by scholarly journals, research organizations, and academia use to confirm the veracity and rigor of the information scientists and other researchers publish as the findings of their research. There are several approaches to performing peer review. Three of the most common:
- Critically examining the methodology a researcher uses and determining whether there are minor, medium or gross flaws in that methodology.
- Identifying the predictions that a paper's conclusions imply and testing to determine whether those implications materialize as implied.
- Replicating the approach a study's authors used and checking to see if the same results are obtained.
In addition to the above noted varied approaches to performing a review, there are also three primary types of peer review. A sample peer review process a journal or book publisher may employ is shown below.
The three major types of peer review are:
Single Blind Review
The names of the reviewers are hidden from the author. This is the traditional method of reviewing and is the most common type by far.
- Reviewer anonymity allows for impartial decisions – the reviewers will not be influenced by the authors.
- Authors may be concerned that reviewers in their field could delay publication, giving the reviewers a chance to publish first.
- Reviewers may use their anonymity as justification for being unnecessarily critical or harsh when commenting on the authors’ work.
Double Blind Review
Both the reviewer and the author are anonymous.
- Author anonymity prevents any reviewer bias, for example based on an author's country of origin or previous controversial work.
- Articles written by prestigious or renowned authors are considered on the basis of the content of their papers, rather than their reputation.
- Reviewers can often identify the author through their writing style, subject matter or self-citation.
Open Review
Reviewer and author are known to each other.
- Some believe this is the best way to prevent malicious comments, stop plagiarism, prevent reviewers from following their own agenda, and encourage open, honest reviewing.
- Others see open review as a less honest process, in which politeness or fear of retribution may cause a reviewer to withhold or tone down criticism.
Based on the feedback journal editors receive from reviewers, they may, at their discretion, ask the original author to address or correct for the failings identified in the reviews. They may also summarily reject the article and say nothing other than "We're sorry we cannot publish your paper. We encourage you to try again."
Here are some review documents. Read or peruse some of them to get a sense of the nature and extent of critique provided by peer review. (Obviously, the review writers don't say anything (or much of anything) about that which they know isn't questionable or problematic.)
For lay readers, who the peer reviewers are and the documentation of their review activities isn't always made public. What one can rely upon, however, is that if the reviewers find material shortcomings in a researcher's approach, premises, findings, inferences, conclusions, etc., the paper won't get
published in a peer reviewed journal.
There is also a class of publication that may or may not appear in a peer reviewed journal, but that carries the same level of intellectual and factual rigor and integrity. That class of documents consists of master's theses and doctoral dissertations. Why is this class of research viewed with equal authority as peer reviewed studies? Because in order to get the degree (Masters or Doctoral), one's research necessarily gets reviewed by a whole panel of folks who do the same things re: one's document/research as peer reviewers do with the content they review for scholarly journals. Of then the sole reason a scholarly and peer reviewed journal won't publish a dissertation is because the person hadn't yet obtained their PhD when they wrote it.
Sidebar:
There are some fields where that strict qualification is not required, for example, the law, wherein controversy rages still over whether a JD,
SJD or
LLM legitimately constitutes the legal industry's equivalent of a PhD. The legal profession argues that a J.D., a graduate degree, is equal to a PhD and that the SJD and LLM degrees are post-graduate degrees. There isn't, that I know of, and controversy over whether and SJD is a research degree; it is. Similarly, an LLM is generally thought of as a academic/teaching degree. A JD is a professional degree, what one needs to practice law as opposed to research or teach it, even though lots of law school instructors have no legal degree other than a JD. Controversy or not, most peer reviewed law journals accept and publish submissions from folks who have "only" a JD.
End of sidebar.
The short of all that is that one need not be among the individuals invited to perform a peer review; however, if one is going to critique and deny the veracity of a peer reviewed journal article, one should be prepared to perform one of the approaches to doing so and then fully document that approach with data, methodology, and, in the case of non-technical research analysis, very rigorously developed and presented inductive arguments.
The
rigor that goes into developing and scrutinizing peer reviewed papers is why I tend to cite them far more often than popular press content and blogs. The thing about scholarly articles/papers is that they don't "leap up and scream 'Hey, over here. Over here.' " One must go looking for them when one has a question about a topic, and sometimes one must read a few of them to get the answer one seeks. That's especially so when one can only come by very narrowly scoped papers....one sometimes is forced to "put two and two together" oneself using the content from multiple papers. (A special type of scholarly document that helps with that is called a "literature review" or "literature summary." It's a document wherein a researcher has gathered all, or substantively so, the existing rigorous thought on a topic and noted what each writer has discovered. Not every researcher publishes their literature review, but you can rest assured that every researcher (or their graduate or post-doc assistants) perform them.)
Lastly, when you encounter various publications, it'll be important to understand what degree of confidence you should reasonably have in the veracity, rigor and credibility of their content. To that end, you will likely find this helpful:
Definitions - Article Types: What's the Difference Between Newspapers, Magazines, and Journals? - LibGuides at University of North Florida .
I suppose I'm talking to a brick wall, aren't I?
My answer is that I suspect that to be so...only if you are looking in a mirror while you talk.