Six Sigma Appropriate for discussions around Six Sigma. Covers everything from Define to Control, Methodology, Statistical Tests and tools.

Attention Visitor:
You may have to register before you can post: click the register link above to proceed. To start viewing messages, select the forum that you want to visit from the selection below.


Sample Size Matters

Six Sigma


Reply
 
Thread Tools Display Modes
Old 02-08-10, 08:07
s_08 s_08 is offline
TreQna White Belt
 
Join Date: Jun 2006
Posts: 2
Thanks: 4
Thanked 11 Times in 2 Posts
Downloads: 0
Uploads: 0
Chats: 0
s_08 is on a distinguished road
Default Sample Size Matters

Just read this in the ASQ handbook -
"The plural of Anecdote is NOT data"
Often we come across people taking decisions, forming opinions based on a few responses or experiences and assume it to be a rational decision based on data...

Whats your opinion ? have you come across such cases ?
Reply With Quote
The Following 6 Users Say Thank You to s_08 For This Useful Post:
Delphi (02-12-10), Haz (02-10-10), Lakota (02-08-10), netneanderthal (02-09-10), sparky (02-08-10), yogambala (02-09-10)
Old 02-08-10, 09:17
Lakota's Avatar
Lakota Lakota is offline
TreQna Grand Master
Recent Blog: Gathering VOC PDF
 
Join Date: Nov 2005
Location: Lake Jackson, Texas, USA
Posts: 6,284
Thanks: 8,394
Thanked 6,237 Times in 2,183 Posts
Downloads: 5
Uploads: 5
Chats: 0
Blog Entries: 83
Lakota has a reputation beyond reputeLakota has a reputation beyond reputeLakota has a reputation beyond reputeLakota has a reputation beyond reputeLakota has a reputation beyond reputeLakota has a reputation beyond reputeLakota has a reputation beyond reputeLakota has a reputation beyond reputeLakota has a reputation beyond reputeLakota has a reputation beyond reputeLakota has a reputation beyond repute
Default Re: Sample Size Matters

Quote:
Originally Posted by s_08 View Post
Just read this in the ASQ handbook -
"The plural of Anecdote is NOT data"
Often we come across people taking decisions, forming opinions based on a few responses or experiences and assume it to be a rational decision based on data...

Whats your opinion ? have you come across such cases ?
Just about everyday of my career. It is human nature. Many (IMHO) will use this technique to justify and validate to get what they want or move others to their way of thinking.

You see the samething in the media with commercials, with politicians, with the news media, -- with people in general. At least that is my view.

In my psychology training this was also known as making "blanket statements" -- using a little data or facts to cover a whole area under discussion, group of behaviors, and even peoples in general.

Isn't the point here not to accept things at face value, but rather check the facts for yourself? I was shocked to learn data used in a political race was correct, however it covered only a very small percentages of the poplulation from which it was drawn and was used in an attempt to influence the voters across many other populations -- not represented by the data.

What are your thoughts as a result of having read this article? Is the author correct in his/her hypothesis? What about the data used in scientific methods (medical research as example)? Isn't it designed to be accurate, repeatable and reproducible?

Perhaps we might be better off saying, "with the few data points I have, it suggests blah, blah. However, "I feel or think" it is mostly accurate. See, most of us naturally operate from a posture of "perception". For the holder of that perception it is most often identified for them as "reality".

Similar to paradigms, we holders of perceptions likely will reject or filter incoming information if it does not mirrow those perceptions or paradigms we hold as true. At least this has been my experience. How about you?

Good discussion.

Blessings,
Lakota
__________________
Follow LakotaEagle on Twitter


Visit TreQna University.org

Begin again in 2010. I pledge to add value and meaning into the lives of others through the sharing of knowledge.

Last edited by Lakota; 02-08-10 at 09:21.
Reply With Quote
The Following 3 Users Say Thank You to Lakota For This Useful Post:
netneanderthal (02-09-10), sparky (02-08-10), yogambala (02-09-10)
Old 02-08-10, 11:28
sparky's Avatar
sparky sparky is offline
TreQna Grand Master
 
Join Date: May 2005
Location: UK
Posts: 5,602
Thanks: 8,034
Thanked 5,834 Times in 2,205 Posts
Downloads: 8
Uploads: 16
Chats: 0
sparky has a reputation beyond reputesparky has a reputation beyond reputesparky has a reputation beyond reputesparky has a reputation beyond reputesparky has a reputation beyond reputesparky has a reputation beyond reputesparky has a reputation beyond reputesparky has a reputation beyond reputesparky has a reputation beyond reputesparky has a reputation beyond reputesparky has a reputation beyond repute
Default Re: Sample Size Matters

Excellent first question.

I think it's true that people do consider experiences as data, and it's wrong (IMHO) in the absolute sense.

I see nothing wrong with drawing on experience, learning from the past, but this ought to be backed up with independent and honest data.

Many will argue that what has happened in the past is fact and is therefore relevant and robust data, but is it? Don't we all see things differently, don't we all view from a different perspective?

I think Lakota offers sound advice suggesting checking the "facts" and where they come from. There are plenty of cases where the truth has been obscured by "fact."

Darrell Huff wrote an interesting book called, "How to lie with statistics." Possibly well worth an hour of your time.
__________________
Stay safe,

Sparky

Aka Grumpy

www.europeanbusinessimprovements.com
Reply With Quote
The Following 3 Users Say Thank You to sparky For This Useful Post:
Lakota (02-08-10), netneanderthal (02-09-10), yogambala (02-09-10)
Old 02-09-10, 01:21
prabh's Avatar
prabh prabh is online now
TreQna Zen Master
 
Join Date: Oct 2005
Location: Mumbai India
Age: 34
Posts: 4,023
Thanks: 2,256
Thanked 3,482 Times in 1,246 Posts
Downloads: 28
Uploads: 2
Chats: 0
Blog Entries: 19
prabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond repute
Send a message via MSN to prabh Send a message via Yahoo to prabh Send a message via Skype™ to prabh
Default Re: Sample Size Matters

Quote:
Originally Posted by sparky View Post
Excellent first question.


Many will argue that what has happened in the past is fact and is therefore relevant and robust data, but is it? .
The problem with previous experience being used to influence current decision is that people often overlook the influencing environments which may have impacted historical outcomes, these influences maynot be prevalent in the future and hence using this as a baseline is not accurate...
__________________
__________________________

Prabh

The Only Sovereign that can rule you is reason
Follow me @ Twitter |Follow TreQna @ Twitter
_____________________________________
Visit my Blog TreQna How To's and More

Our Partner Sites

European Business Improvement
TreQna University



Reply With Quote
The Following 5 Users Say Thank You to prabh For This Useful Post:
Lakota (02-09-10), netneanderthal (02-09-10), santosh (02-14-10), sparky (02-09-10), yogambala (02-09-10)
Old 02-09-10, 09:56
s_08 s_08 is offline
TreQna White Belt
 
Join Date: Jun 2006
Posts: 2
Thanks: 4
Thanked 11 Times in 2 Posts
Downloads: 0
Uploads: 0
Chats: 0
s_08 is on a distinguished road
Default Re: Sample Size Matters

I think we need to distinguish between decisions based on experience and those based on real data.

While it is human to learn from others experiences, it might be fatal to treat these as "data" & assume/claim the process to be rational, data based decision making.
Reply With Quote
The Following 5 Users Say Thank You to s_08 For This Useful Post:
Lakota (02-09-10), netneanderthal (02-09-10), prabh (02-09-10), sparky (02-09-10), yogambala (02-09-10)
Old 02-09-10, 13:49
netneanderthal's Avatar
netneanderthal netneanderthal is online now
TreQna Black Belt
 
Join Date: Oct 2009
Location: Mumbai, India
Posts: 350
Thanks: 2,010
Thanked 1,390 Times in 349 Posts
Downloads: 4
Uploads: 2
Chats: 0
netneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond repute

Awards Showcase

Default Re: Sample Size Matters

Here's my two cents on this interesting discussion thread:

While all of this in some way seems to pertain to a halo effect of generalization based on a small set of observations, I have seen something a little worse... Not only are decisions taken on a small set of observations, but I have seen the halo effect being applied thanks to the experience faced in a smaller subset of these observations...

So the decision maker's take on the small data set is "This is interesting, but I have seen that this is not the case - my observations of the data is blah blah blah, particularly based on what we saw the last couple of times"...

Talk about compounding effects...

On a lighter note to the mods - we really need to get an emoticon of someone banging their head against the wall to adequately capture forum member emotions when describing our interactions with people in our organizations...
Reply With Quote
The Following 5 Users Say Thank You to netneanderthal For This Useful Post:
prabh (02-09-10), santosh (02-14-10), sparky (02-09-10), s_08 (02-10-10), yogambala (02-09-10)
Old 02-09-10, 14:10
prabh's Avatar
prabh prabh is online now
TreQna Zen Master
 
Join Date: Oct 2005
Location: Mumbai India
Age: 34
Posts: 4,023
Thanks: 2,256
Thanked 3,482 Times in 1,246 Posts
Downloads: 28
Uploads: 2
Chats: 0
Blog Entries: 19
prabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond reputeprabh has a reputation beyond repute
Send a message via MSN to prabh Send a message via Yahoo to prabh Send a message via Skype™ to prabh
Default Re: Sample Size Matters

Quote:
On a lighter note to the mods - we really need to get an emoticon of someone banging their head against the wall to adequately capture forum member emotions when describing our interactions with people in our organizations...
lol we 'll see what we can do
__________________
__________________________

Prabh

The Only Sovereign that can rule you is reason
Follow me @ Twitter |Follow TreQna @ Twitter
_____________________________________
Visit my Blog TreQna How To's and More

Our Partner Sites

European Business Improvement
TreQna University



Reply With Quote
The Following 2 Users Say Thank You to prabh For This Useful Post:
sparky (02-09-10), yogambala (02-09-10)
Old 02-10-10, 01:18
Haz's Avatar
Haz Haz is offline
Treqna Zen Master
 
Join Date: Dec 2006
Location: Birmingham
Age: 44
Posts: 2,494
Thanks: 515
Thanked 2,315 Times in 732 Posts
Downloads: 4
Uploads: 1
Chats: 0
Haz will become famous soon enoughHaz will become famous soon enoughHaz will become famous soon enoughHaz will become famous soon enoughHaz will become famous soon enoughHaz will become famous soon enoughHaz will become famous soon enoughHaz will become famous soon enoughHaz will become famous soon enoughHaz will become famous soon enoughHaz will become famous soon enough
Default Re: Sample Size Matters

Quote:
Originally Posted by sparky View Post
Excellent first question.

I think it's true that people do consider experiences as data, and it's wrong (IMHO) in the absolute sense.

I see nothing wrong with drawing on experience, learning from the past, but this ought to be backed up with independent and honest data.

Many will argue that what has happened in the past is fact and is therefore relevant and robust data, but is it? Don't we all see things differently, don't we all view from a different perspective?

I think Lakota offers sound advice suggesting checking the "facts" and where they come from. There are plenty of cases where the truth has been obscured by "fact."

Darrell Huff wrote an interesting book called, "How to lie with statistics." Possibly well worth an hour of your time.
This is an eye opening thread for me, I have many times uses the , "in the automotive industry" as a way to gain approaval to "something". I have of late not used it because i felt almost as if i was saying i am better than you.

I have and will always use the "speak with data" approach and to bring these two together is going to lead to a lot of interesting conversations at work.

Brilliant first post.
__________________
Regards,

Haz

Keep right on till the end of the road

http://www.europeanbusinessimprovements.com/
Reply With Quote
The Following 5 Users Say Thank You to Haz For This Useful Post:
Lakota (02-10-10), netneanderthal (02-12-10), sparky (02-10-10), s_08 (02-10-10), yogambala (02-10-10)
Old 02-12-10, 03:27
Delphi's Avatar
Delphi Delphi is offline
Moderator
 
Join Date: May 2007
Location: Broken Arrow, OK
Age: 32
Posts: 1,087
Thanks: 2,198
Thanked 2,561 Times in 785 Posts
Downloads: 4
Uploads: 0
Chats: 0
Delphi is on a distinguished roadDelphi is on a distinguished roadDelphi is on a distinguished roadDelphi is on a distinguished roadDelphi is on a distinguished roadDelphi is on a distinguished roadDelphi is on a distinguished roadDelphi is on a distinguished roadDelphi is on a distinguished roadDelphi is on a distinguished roadDelphi is on a distinguished road
Send a message via Yahoo to Delphi
Default Re: Sample Size Matters

Interesting thread and I like how it is developing.

What I find interesting is that on one hand, we have a fair amount of "Experince Talkers" speaking to experience as data while we have "Real Data Talkers" speaking to just data. Not surprising as process improvement, hypothesis testing, business decision making, etc seems to polarize the two as there is a real financial risk involved.

Perhaps there is a balance between the two. Speak with the data yes, but I wouldn't necessarily ignore experience either. Both are valuable but in different ways. For instance, experience tells me that when the stove is turned on, the burner was hot because I once put my hand on it and I can assume that when I put my hand on it again when it is on, it will be hot again. Data will tell me that 99 times out of 100 that when the stove was turned on that it was hot, at what temperature the stove is hot to me, how long it takes the stove to get hot, etc.

As my manager tells me "Experience is personal. Data is universal."

Just more of my random thoughts.
__________________
"I think therefore I am.” René Descartes
“I act therefore I impact.” Dr. Paul Hersey
Reply With Quote
The Following 5 Users Say Thank You to Delphi For This Useful Post:
Lakota (02-12-10), netneanderthal (02-12-10), prabh (02-12-10), sparky (02-12-10), yogambala (02-12-10)
Old 02-12-10, 11:20
netneanderthal's Avatar
netneanderthal netneanderthal is online now
TreQna Black Belt
 
Join Date: Oct 2009
Location: Mumbai, India
Posts: 350
Thanks: 2,010
Thanked 1,390 Times in 349 Posts
Downloads: 4
Uploads: 2
Chats: 0
netneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond reputenetneanderthal has a reputation beyond repute

Awards Showcase

Default Re: Sample Size Matters

Quote:
Originally Posted by Delphi View Post
... Perhaps there is a balance between the two. Speak with the data yes, but I wouldn't necessarily ignore experience either...
An interesting point by Delphi which reminds me of something my ex-super boss used to tell me...

"Never ignore your gut feel, but it sure is good to have the data that proves it!"

Needless to say, my ex-super boss had made a pretty good career of using data and then applying his experience to what he saw... An admirable trait to emulate and ensure that the halo effect I mentioned in my earlier post in this thread did not rear it's head...

I never got to quite figure out how he did it as I ended up moving companies before I could spend enough time with him to see how he did that...

But I think every organization needs a few people of his disposition...

Last edited by netneanderthal; 02-12-10 at 11:25.
Reply With Quote
The Following 6 Users Say Thank You to netneanderthal For This Useful Post:
Delphi (02-15-10), Haz (02-14-10), Lakota (02-13-10), sparky (02-12-10), s_08 (02-12-10), yogambala (02-12-10)
Reply

Bookmarks


Currently Active Users Viewing This Thread: 1 (0 members and 1 guests)
 
Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Forum Jump

Similar Threads
Thread Thread Starter Forum Replies Last Post
Sample size for weibull distribution cg_ong Six Sigma 2 05-01-09 21:16
Sample Size considerations Parameswara Reddy Six Sigma 5 07-17-08 12:43
Sample Size GauravRai Six Sigma 40 12-27-06 22:21
Minimum sample size rathoras Minitab Assistance 4 11-25-06 11:59
Sample Size joeban Six Sigma 6 02-09-06 16:29