asleif
In the example I gave for an experiment on faith healing, the structure was so thought out as to allow a statistical analysis of what happened to which group so as to be able to determine any difference BETWEEN 'treatment' groups (i.e. genuine, fake and control), and any difference WITHIN treatment groups (belivers, agnostics and cynics).
This reduces a potentialy complex system to one where one can determine ANY benefit AND 'where' that benefit comes from. This initial testing would allow re-testing of specific features that the first experiment highlighted worthy of iunvestigation.
For example, it could be that there was no statistical differnce between genuine healers and fae healers, in terms of benefits, but that there WAS a statistical benefit to those in the two groups receiving 'healing' be it genuine or fake' who believed it worked; a placebo effect to be sure, but if you can show a placebo effect can give a tangible repeatable benefit, then learning how to harness placebo effects with great efficiency could save lives, which is far more important than keeping the 'alternative therapy' industry going.
You're right to say my statement is a good rule of thumb for simple linear causality, and equally right to add the proviso you do, but I am assuming that any decent research would be a set of experiments designed to drill down through as many layers as possible to find where there IS testability.
I see possibility that, just as they made complex clockwork devices (orreries) to mimic the movement of planets as seen from Earth that bore no relation to reality BUT MAPPED REALITY, so too some 'alternative' therapies etc. may map reality (i.e. work), but that the mechanism is a fanciful one that needs development and understanding.
Thus my example of accupunture. All of the ancient stuff was a load of cobblers that had developed to explain something that worked; a 'focus', as I like to call it. You don't need to know about channels of chi or jade gates or the red emperor, you don't even need needles; you can use little electrodes like are used for EKG's/ECG's.
This was discovered by patient testing and open mindedness to both the fact the treatment obviously worked, but also to the fact accepting four-thousand year old explanations of HOW it worked might be a bit 'kin stupid.
But, you will still find 'traditonal' accupuncture being taught; a bit like teaching orbital mechanics using an orrery. And you will still have people complacently accepting ancient wisdom, just like accupuncture, rather than develop a decent scientific approach to the subject and perhaps gain greater benefits.
Little Toe:
An anecdote is a short amusing or interesting true story.
Wrong, but usefully wrong as it illuminates the heart of the issue for some.
Find me a dictionary that uses 'true' in defining 'anecdote'. You can't. You seem to have a presupposition that anecdotal evidence is true until proved false.
I have an assumption that an anecdotal experience that cannot be duplicated scientifically is made up, or a misconception, or a subjective perception of reality, and that until it is tested scientifically, is at most an indicator of something that may deserve study.
If 90% of people on cabbage treatment recovered from malignant cancer, with no other treatment being offered, as compared to 20% recovering in a test group - with every indication that said treatment shouldn't work - I think we'd have the basis for some serious research into why it works.
Yup.
If (similarly) 3000 people reported the same result, though none of the above-stated statistics were available, would that be a reasonable start point for research?
Yup. Such claims have been investigated. And faith healing has never been proven to work in any duplicable or reliable fashion that could be used as a mass therapy.
And people 'reporting' the same result, as distinct from being studied properly, may lie, may not have what they sincerely claim they have, may have so much tied up in believing it works they'll believe they are undergoing remission when they are not, may be a forteen year-old boy making a prank call to the reporting line.....
... remember, studying a group of people who believe something that cannot be proved normally proves they believe in what they believe in, which is what you knew to start of with.
It doesn't prove god allah jesus or bugger all. The High Priest of Quezlacotl (sp?) probably sincerely believed he needed to cut all those hearts out to keep the sun rising; are we going to defend him not testing this assumption?
Or would we debunk the idea before the data was in? How many studies would be required before we accepted the result, else gave up researching it?
Again, people SAYING something means nothing. If people saying something meant anything, we would be playing with a lion in our short-sleeved shits and stay-prest trousers whilst our poodle-skirted wives made our sandwiches before we went off to clear all the bones of Armagedon's dead away! I'm not talking about debunking ideas before data is in, I'm challanging those who believe in them to do something useful rather than complain about being asked for proof.
It sometimes seems that people consider the right to hold a certain belief is more important than being able to defend that belief competantly. It that belief is innocuous, fine. If it's harmful; not. And just as swindling people of money by making false claims of an investment is wrong, so to is swindling people out of hope or money by making false claims of a treatment.
Is viable and proper research testing restricted to things that don't appear "stupid"? (I had to get back on-thread somehow)
I don't care WHAT things 'look' like. Hell, Heisenburg's Uncertainty Theory and quite a lot of Quantum ChromoDynamics is VERY silly. BUT YOU CAN TEST IT.
Incidentally, nice side issue of "the Flood", btw - you kinda love that one, huh?
I have never, ever, ever had anyone come up with a rebuttal of the dendrochronological evidence that points to trees growing before during and after the flood with no interuption or harm. To me this means anyone taking a 'the Bible is the literal inspired flawless word of god' stance is a fool, as the facts show they are wrong.
Once you open people up to the Bible being a historical document, rather than inspired god speech, you can generally have far more interesting conversations with them as 'coz it sez it in the Bible' ceases to be a decent argument.
I just think it cuts to the chase... no Flood, no literal Bible interpretation, less people dying. I'd do the same to any text-obsessed religionist.
Further, none of my comments on this thread haver been intended to be derogatory of your own position.
Ah likewise, this is just a fun conversation.