tag:blogger.com,1999:blog-157574472024-03-09T21:46:31.531-05:00Dwaine Snow's Thoughts on Databases and Data ManagementHi, and welcome to my blog.
I have been working for IBM and working with DB2 for the past 22 years, and I recently started to work with our new colleagues from Netezza. Although I work for IBM, the views expressed are my own and not necessarily those of IBM and its affiliates. The views and opinions expressed by visitors to this blog are theirs and do not necessarily reflect mine.Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.comBlogger35125tag:blogger.com,1999:blog-15757447.post-67237010771600618052012-11-07T21:07:00.000-05:002012-11-07T21:08:33.144-05:00Have been writing some posts for the IBM Expert Integrated Systems Website.<span style="color: #444444;">You can check out my latest post about the new PureData Systems at these links. </span><br />
<br /><div class="MsoNormal" style="margin-left: .25in; mso-layout-grid-align: none; mso-pagination: none; tab-stops: 11.0pt .5in; text-autospace: none;">
<span style="font-family: "Lucida Grande";"><a href="http://expertintegratedsystemsblog.com/index.php/2012/10/optimizing-for-transactions-or-over-engineering-for-everything/"><span style="color: blue; font-family: Arial; font-size: 10.0pt; text-decoration: none; text-underline: none;">Optimizing for Transactions, or Over Engineering for
Everything (October 29)</span></a></span></div>
<div class="MsoNormal" style="margin-left: .25in; mso-layout-grid-align: none; mso-pagination: none; tab-stops: 11.0pt .5in; text-autospace: none;">
<span style="font-family: "Lucida Grande";"><a href="http://expertintegratedsystemsblog.com/index.php/2012/10/patching-engineered-systems-compared-to-expertly-integrated-systems/"><span style="color: blue; font-family: Arial; font-size: 10.0pt; text-decoration: none; text-underline: none;">Patching Engineered Systems compared to Expertly
Integrated Systems (October 18)</span></a></span></div>
<div class="MsoNormal" style="margin-left: .25in; mso-layout-grid-align: none; mso-pagination: none; tab-stops: 11.0pt .5in; text-autospace: none;">
<span style="font-family: "Lucida Grande";"><a href="http://expertintegratedsystemsblog.com/index.php/2012/10/comparison-of-the-puredata-system-for-analytics-and-the-exadata-engineered-system/"><span style="color: blue; font-family: Arial; font-size: 10.0pt; text-decoration: none; text-underline: none;">Do More with Less using Expert Integrated Systems (October
16)</span></a></span></div>
<div class="MsoNormal" style="margin-left: .25in; mso-layout-grid-align: none; mso-pagination: none; tab-stops: 11.0pt .5in; text-autospace: none;">
<span style="font-family: "Lucida Grande";"><a href="http://expertintegratedsystemsblog.com/index.php/2012/10/expert-it-2012-event-recap/"><span style="color: blue; font-family: Arial; font-size: 10.0pt; text-decoration: none; text-underline: none;">"We've Seen the New Doors":<span style="mso-spacerun: yes;"> </span>Expert IT Event Recap, Resources &
Comparison to Engineered Systems (October 10)</span></a></span></div>
<div class="MsoNormal" style="margin-left: .25in; mso-layout-grid-align: none; mso-pagination: none; tab-stops: 11.0pt .5in; text-autospace: none;">
<span style="font-family: "Lucida Grande";"><a href="http://expertintegratedsystemsblog.com/index.php/2012/10/exa-gineering-cant-catch-up-to-expert-integrated-systems/"><span style="color: blue; font-family: Arial; font-size: 10.0pt; text-decoration: none; text-underline: none;">Exa-gineering can't catch up to Expert Integrated Systems
(October 1)</span></a></span></div>
<div class="MsoNormal" style="margin-left: .25in; mso-layout-grid-align: none; mso-pagination: none; tab-stops: 11.0pt .5in; text-autospace: none;">
<span style="font-family: "Lucida Grande";"><a href="http://expertintegratedsystemsblog.com/index.php/2012/09/extra-engineering-or-an-expert-integrated-system-fit-for-purpose-you-decide/"><span style="color: blue; font-family: Arial; font-size: 10.0pt; text-decoration: none; text-underline: none;">Extra Engineering, or an Expert Integrated System?<span style="mso-spacerun: yes;"> </span>Fit for purpose - you decide (September 27)</span></a></span></div>
<div class="MsoNormal" style="margin-left: .25in; mso-layout-grid-align: none; mso-pagination: none; tab-stops: 11.0pt .5in; text-autospace: none;">
<span style="font-family: "Lucida Grande";"><a href="http://expertintegratedsystemsblog.com/index.php/2012/09/exadata-jack-of-all-trades-master-of-none/"><span style="color: blue; font-family: Arial; font-size: 10.0pt; text-decoration: none; text-underline: none;">Exadata - Jack of all trades, master of none (September
24)</span></a></span></div>
Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com2tag:blogger.com,1999:blog-15757447.post-48854109089747346652012-09-25T10:57:00.006-04:002012-09-25T13:40:25.991-04:00Sorry for the lack of posts<span style="color: #444444;">I was asked to write a series of posts for the IBM Expert Integrated System blog area. Check out my first post</span> <a href="http://expertintegratedsystemsblog.com/index.php/2012/09/exadata-jack-of-all-trades-master-of-none/" target="_blank">here</a> Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com1tag:blogger.com,1999:blog-15757447.post-78277845956883198402012-08-06T13:49:00.005-04:002012-08-07T12:41:00.014-04:00The Downside of Down Casing<style>
<!--
/* Font Definitions */
@font-face
{font-family:"Courier New";
panose-1:2 7 3 9 2 2 5 2 4 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536859905 -1073711037 9 0 511 0;}
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;
mso-font-charset:2;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:0 268435456 0 0 -2147483648 0;}
@font-face
{font-family:"MS 明朝";
mso-font-charset:78;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-1593833729 1073750107 16 0 415 0;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-1593833729 1073750107 16 0 415 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536870145 1073743103 0 0 415 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel1, li.MsoNoteLevel1, div.MsoNoteLevel1
{mso-style-priority:99;
margin:0in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:0in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:1;
mso-list:l0 level1 lfo1;
tab-stops:list 0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel1CxSpFirst, li.MsoNoteLevel1CxSpFirst, div.MsoNoteLevel1CxSpFirst
{mso-style-priority:99;
mso-style-type:export-only;
margin:0in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:0in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:1;
mso-list:l0 level1 lfo1;
tab-stops:list 0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel1CxSpMiddle, li.MsoNoteLevel1CxSpMiddle, div.MsoNoteLevel1CxSpMiddle
{mso-style-priority:99;
mso-style-type:export-only;
margin:0in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:0in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:1;
mso-list:l0 level1 lfo1;
tab-stops:list 0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel1CxSpLast, li.MsoNoteLevel1CxSpLast, div.MsoNoteLevel1CxSpLast
{mso-style-priority:99;
mso-style-type:export-only;
margin:0in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:0in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:1;
mso-list:l0 level1 lfo1;
tab-stops:list 0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel2, li.MsoNoteLevel2, div.MsoNoteLevel2
{mso-style-noshow:yes;
mso-style-priority:99;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.75in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:2;
mso-list:l0 level2 lfo1;
tab-stops:list .5in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel2CxSpFirst, li.MsoNoteLevel2CxSpFirst, div.MsoNoteLevel2CxSpFirst
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.75in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:2;
mso-list:l0 level2 lfo1;
tab-stops:list .5in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel2CxSpMiddle, li.MsoNoteLevel2CxSpMiddle, div.MsoNoteLevel2CxSpMiddle
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.75in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:2;
mso-list:l0 level2 lfo1;
tab-stops:list .5in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel2CxSpLast, li.MsoNoteLevel2CxSpLast, div.MsoNoteLevel2CxSpLast
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.75in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:2;
mso-list:l0 level2 lfo1;
tab-stops:list .5in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel3, li.MsoNoteLevel3, div.MsoNoteLevel3
{mso-style-noshow:yes;
mso-style-priority:99;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:1.25in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:3;
mso-list:l0 level3 lfo1;
tab-stops:list 1.0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel3CxSpFirst, li.MsoNoteLevel3CxSpFirst, div.MsoNoteLevel3CxSpFirst
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:1.25in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:3;
mso-list:l0 level3 lfo1;
tab-stops:list 1.0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel3CxSpMiddle, li.MsoNoteLevel3CxSpMiddle, div.MsoNoteLevel3CxSpMiddle
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:1.25in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:3;
mso-list:l0 level3 lfo1;
tab-stops:list 1.0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel3CxSpLast, li.MsoNoteLevel3CxSpLast, div.MsoNoteLevel3CxSpLast
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:1.25in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:3;
mso-list:l0 level3 lfo1;
tab-stops:list 1.0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel4, li.MsoNoteLevel4, div.MsoNoteLevel4
{mso-style-noshow:yes;
mso-style-priority:99;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:1.75in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:4;
mso-list:l0 level4 lfo1;
tab-stops:list 1.5in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel4CxSpFirst, li.MsoNoteLevel4CxSpFirst, div.MsoNoteLevel4CxSpFirst
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:1.75in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:4;
mso-list:l0 level4 lfo1;
tab-stops:list 1.5in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel4CxSpMiddle, li.MsoNoteLevel4CxSpMiddle, div.MsoNoteLevel4CxSpMiddle
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:1.75in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:4;
mso-list:l0 level4 lfo1;
tab-stops:list 1.5in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel4CxSpLast, li.MsoNoteLevel4CxSpLast, div.MsoNoteLevel4CxSpLast
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:1.75in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:4;
mso-list:l0 level4 lfo1;
tab-stops:list 1.5in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel5, li.MsoNoteLevel5, div.MsoNoteLevel5
{mso-style-noshow:yes;
mso-style-priority:99;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:2.25in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:5;
mso-list:l0 level5 lfo1;
tab-stops:list 2.0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel5CxSpFirst, li.MsoNoteLevel5CxSpFirst, div.MsoNoteLevel5CxSpFirst
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:2.25in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:5;
mso-list:l0 level5 lfo1;
tab-stops:list 2.0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel5CxSpMiddle, li.MsoNoteLevel5CxSpMiddle, div.MsoNoteLevel5CxSpMiddle
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:2.25in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:5;
mso-list:l0 level5 lfo1;
tab-stops:list 2.0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel5CxSpLast, li.MsoNoteLevel5CxSpLast, div.MsoNoteLevel5CxSpLast
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:2.25in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:5;
mso-list:l0 level5 lfo1;
tab-stops:list 2.0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel6, li.MsoNoteLevel6, div.MsoNoteLevel6
{mso-style-noshow:yes;
mso-style-priority:99;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:2.75in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:6;
mso-list:l0 level6 lfo1;
tab-stops:list 2.5in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel6CxSpFirst, li.MsoNoteLevel6CxSpFirst, div.MsoNoteLevel6CxSpFirst
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:2.75in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:6;
mso-list:l0 level6 lfo1;
tab-stops:list 2.5in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel6CxSpMiddle, li.MsoNoteLevel6CxSpMiddle, div.MsoNoteLevel6CxSpMiddle
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:2.75in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:6;
mso-list:l0 level6 lfo1;
tab-stops:list 2.5in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel6CxSpLast, li.MsoNoteLevel6CxSpLast, div.MsoNoteLevel6CxSpLast
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:2.75in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:6;
mso-list:l0 level6 lfo1;
tab-stops:list 2.5in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel7, li.MsoNoteLevel7, div.MsoNoteLevel7
{mso-style-noshow:yes;
mso-style-priority:99;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:3.25in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:7;
mso-list:l0 level7 lfo1;
tab-stops:list 3.0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel7CxSpFirst, li.MsoNoteLevel7CxSpFirst, div.MsoNoteLevel7CxSpFirst
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:3.25in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:7;
mso-list:l0 level7 lfo1;
tab-stops:list 3.0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel7CxSpMiddle, li.MsoNoteLevel7CxSpMiddle, div.MsoNoteLevel7CxSpMiddle
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:3.25in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:7;
mso-list:l0 level7 lfo1;
tab-stops:list 3.0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel7CxSpLast, li.MsoNoteLevel7CxSpLast, div.MsoNoteLevel7CxSpLast
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:3.25in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:7;
mso-list:l0 level7 lfo1;
tab-stops:list 3.0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel8, li.MsoNoteLevel8, div.MsoNoteLevel8
{mso-style-noshow:yes;
mso-style-priority:99;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:3.75in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:8;
mso-list:l0 level8 lfo1;
tab-stops:list 3.5in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel8CxSpFirst, li.MsoNoteLevel8CxSpFirst, div.MsoNoteLevel8CxSpFirst
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:3.75in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:8;
mso-list:l0 level8 lfo1;
tab-stops:list 3.5in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel8CxSpMiddle, li.MsoNoteLevel8CxSpMiddle, div.MsoNoteLevel8CxSpMiddle
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:3.75in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:8;
mso-list:l0 level8 lfo1;
tab-stops:list 3.5in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel8CxSpLast, li.MsoNoteLevel8CxSpLast, div.MsoNoteLevel8CxSpLast
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:3.75in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:8;
mso-list:l0 level8 lfo1;
tab-stops:list 3.5in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel9, li.MsoNoteLevel9, div.MsoNoteLevel9
{mso-style-noshow:yes;
mso-style-priority:99;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:4.25in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:9;
mso-list:l0 level9 lfo1;
tab-stops:list 4.0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel9CxSpFirst, li.MsoNoteLevel9CxSpFirst, div.MsoNoteLevel9CxSpFirst
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:4.25in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:9;
mso-list:l0 level9 lfo1;
tab-stops:list 4.0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel9CxSpMiddle, li.MsoNoteLevel9CxSpMiddle, div.MsoNoteLevel9CxSpMiddle
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:4.25in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:9;
mso-list:l0 level9 lfo1;
tab-stops:list 4.0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.MsoNoteLevel9CxSpLast, li.MsoNoteLevel9CxSpLast, div.MsoNoteLevel9CxSpLast
{mso-style-noshow:yes;
mso-style-priority:99;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:4.25in;
margin-bottom:.0001pt;
mso-add-space:auto;
text-indent:-.25in;
mso-pagination:widow-orphan;
page-break-after:avoid;
mso-outline-level:9;
mso-list:l0 level9 lfo1;
tab-stops:list 4.0in;
font-size:12.0pt;
font-family:Verdana;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:-227;
mso-list-template-ids:2113166136;}
@list l0:level1
{mso-level-number-format:bullet;
mso-level-style-link:"Note Level 1";
mso-level-text:"";
mso-level-tab-stop:0in;
mso-level-number-position:left;
margin-left:0in;
text-indent:0in;
font-family:Symbol;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-style-link:"Note Level 2";
mso-level-text:;
mso-level-tab-stop:.5in;
mso-level-number-position:left;
margin-left:.75in;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-style-link:"Note Level 3";
mso-level-text:o;
mso-level-tab-stop:1.0in;
mso-level-number-position:left;
margin-left:1.25in;
text-indent:-.25in;
font-family:"Courier New";
mso-bidi-font-family:"Times New Roman";}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-style-link:"Note Level 4";
mso-level-text:;
mso-level-tab-stop:1.5in;
mso-level-number-position:left;
margin-left:1.75in;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-style-link:"Note Level 5";
mso-level-text:;
mso-level-tab-stop:2.0in;
mso-level-number-position:left;
margin-left:2.25in;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-style-link:"Note Level 6";
mso-level-text:;
mso-level-tab-stop:2.5in;
mso-level-number-position:left;
margin-left:2.75in;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-style-link:"Note Level 7";
mso-level-text:o;
mso-level-tab-stop:3.0in;
mso-level-number-position:left;
margin-left:3.25in;
text-indent:-.25in;
font-family:"Courier New";
mso-bidi-font-family:"Times New Roman";}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-style-link:"Note Level 8";
mso-level-text:;
mso-level-tab-stop:3.5in;
mso-level-number-position:left;
margin-left:3.75in;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-style-link:"Note Level 9";
mso-level-text:;
mso-level-tab-stop:4.0in;
mso-level-number-position:left;
margin-left:4.25in;
text-indent:-.25in;
font-family:Wingdings;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
-->
</style>
<br />
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
ANSI
standard naming in databases is to Upper Case the names of tables and columns
in the database. So, for the table users (see the statement below), the table
name and the two column names should be stored in the database as USERS,
USERID, and NAME. </div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
<br /></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444; text-indent: 0.5in;">
<b style="mso-bidi-font-weight: normal;">create table users
(UserID int, Name Char(60))</b></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444; text-indent: 0.5in;">
<br /></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
Now, to
make things “easy”, ANSI standard databases also Upper Case references to
tables and columns automatically. So the statement <b style="mso-bidi-font-weight: normal;">select userid from users</b> would be automatically converted to <b style="mso-bidi-font-weight: normal;">select USERID from USERS</b> as it is
optimized, so that it will not fail.</div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
<br /></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
In DB2
and Netezza if you run <b style="mso-bidi-font-weight: normal;">select userid
from users</b> or <b style="mso-bidi-font-weight: normal;">select USERID from
users</b>, or <b style="mso-bidi-font-weight: normal;">select UserID from Users</b>
, you get all users in the table. No matter what mix of case you use for the
column named UserID, you get the same results, unless you enclose the table
name or column name in quotes. If the name is enclosed in quotes, then the case
is preserved, and must match exactly. </div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
<br /></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
So, for
the table users2 created like</div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
<br /></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444; text-indent: 0.5in;">
<b style="mso-bidi-font-weight: normal;">create table “USERS2”
(“USERID” int, “NAME” char(60))</b></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
<br /></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
Could be accessed
in DB2 and Netezza using any of the following SQL statement, because of the way
DB2 adheres to ANSI standards and Upper Cases the names.</div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
<br /></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
<span style="mso-tab-count: 1;"> </span><b style="mso-bidi-font-weight: normal;">select
USERID from USERS2</b></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
<b style="mso-bidi-font-weight: normal;"><span style="mso-tab-count: 1;"> </span>select
userid from users2</b></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
<b style="mso-bidi-font-weight: normal;"><span style="mso-tab-count: 1;"> </span>select
“USERID” from “USERS2”</b></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
<b style="mso-bidi-font-weight: normal;"><span style="mso-tab-count: 1;"> </span>select
“USERID” from users2</b></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
<b style="mso-bidi-font-weight: normal;"><span style="mso-tab-count: 1;"> </span>etc.</b></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
<br /></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
For databases
that down case the table and column names, 3 of the above 4 statements would
fail on the USERS2 table, and only the statement <b style="mso-bidi-font-weight: normal;">select “USERID” from “USERS2”</b> would run.</div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
<br /></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
Isn’t the
way that DB2 and Netezza work a lot more intuitive, and a lot easier? And since
you do not need to worry about the way that the SQL was written in your
existing application, this is a lot less work to make your existing
applications and BI report run.</div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
<br /></div>
<div class="MsoNoteLevel1CxSpMiddle" style="color: #444444;">
Why cause
more work for yourself?</div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com1tag:blogger.com,1999:blog-15757447.post-71894329039819947542012-07-17T10:11:00.003-04:002012-07-17T13:54:25.159-04:00<div style="color: #444444;">
Nucleus research reports a 241% ROI using Big Data to enable larger, more complex analytics</div>
<br />
<div style="color: blue;">
<a href="http://nucleusresearch.com/research/notes-and-reports/the-big-returns-from-big-data/" target="_blank">LINK</a></div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com1tag:blogger.com,1999:blog-15757447.post-10413787656073518602012-07-16T13:05:00.002-04:002012-07-16T13:05:32.515-04:00Adding a 4th V to BIG Data - Veracity<style>
<!--
/* Font Definitions */
@font-face
{font-family:"MS 明朝";
mso-font-charset:78;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536870145 1073743103 0 0 415 0;}
@font-face
{font-family:"Arial Narrow";
panose-1:2 11 5 6 2 2 2 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
span.apple-style-span
{mso-style-name:apple-style-span;
mso-style-unhide:no;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
-->
</style>
<br />
<div class="MsoNormal" style="color: #444444;">
<span class="apple-style-span"><span style="font-family: "Arial Narrow"; font-size: 14pt;">I talked a week or so ago about IBM’s 3 V’s of Big Data. Maybe
it is time to add a 4<sup>th</sup> V, for <b style="mso-bidi-font-weight: normal;">Veracity</b>.</span></span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span class="apple-style-span"><span style="font-family: "Arial Narrow"; font-size: 14pt;">Veracity deals with uncertain or imprecise data. In traditional
data warehouses there was always the assumption that the data is certain,
clean, and precise. That is why so much time was spent on ETL/ELT, Master Data
Management, Data Lineage, Identity Insight/Assertion, etc. </span></span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span class="apple-style-span"><span style="font-family: "Arial Narrow"; font-size: 14pt;">However, when we start talking about social media data
like Tweets, Facebook posts, etc. how much faith can or should we put in the
data. Sure, this data can be used as a count toward your sentiment, but you
would not count it toward your total sales and report on that. </span></span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span class="apple-style-span"><span style="font-family: "Arial Narrow"; font-size: 14pt;">Two of the now 4 V’s of Big Data are actually working
against the Veracity of the data. Both Variety and Velocity hinder the ability
to cleanse the data before analyzing it and making decisions.</span></span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span class="apple-style-span"><span style="font-family: "Arial Narrow"; font-size: 14pt;">Due to the sheer velocity of some data (like stock
trades, or machine/sensor generated events), you cannot spend the time to
“cleanse” it and get rid of the uncertainty, so you must process it as is -
understanding the uncertainty in the data. And as you bring multi-structured
data together, determining the origin of the data, and fields that correlate
becomes nearly impossible. </span></span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span class="apple-style-span"><span style="font-family: "Arial Narrow"; font-size: 14pt;">When we talk Big Data, I think we need to define trusted
data differently than we have in the past. I believe that the definition of
trusted data depends on the way you are using the data and applying it to your
business. The “trust” you have in the data will also influence the value of the
data, and the impact of the decisions you make based on that data.</span></span></div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com14tag:blogger.com,1999:blog-15757447.post-27723315864239886442012-07-13T10:52:00.001-04:002012-07-13T10:52:37.272-04:00A discussion of data models for analytics<style>
<!--
/* Font Definitions */
@font-face
{font-family:Arial;
panose-1:2 11 6 4 2 2 2 2 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536859905 -1073711037 9 0 511 0;}
@font-face
{font-family:"MS 明朝";
mso-font-charset:78;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:"MS 明朝";
mso-font-charset:78;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-520092929 1073786111 9 0 415 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536870145 1073743103 0 0 415 0;}
@font-face
{font-family:"Arial Unicode MS";
panose-1:2 11 6 4 2 2 2 2 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-134238209 -371195905 63 0 4129279 0;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
span.IBMsup
{mso-style-name:IBM_sup;
mso-style-unhide:no;
mso-style-parent:"";
mso-ansi-font-size:10.0pt;
font-family:Arial;
mso-ascii-font-family:Arial;
mso-hansi-font-family:Arial;
vertical-align:super;}
p.IBMTextStyle1, li.IBMTextStyle1, div.IBMTextStyle1
{mso-style-name:IBM_TextStyle1;
mso-style-unhide:no;
mso-style-parent:"";
margin-top:.2in;
margin-right:0in;
margin-bottom:0in;
margin-left:0in;
margin-bottom:.0001pt;
mso-pagination:none;
mso-hyphenate:none;
font-size:10.0pt;
mso-bidi-font-size:12.0pt;
font-family:Arial;
mso-fareast-font-family:"Arial Unicode MS";
mso-bidi-font-family:Tahoma;
mso-font-kerning:.5pt;
mso-fareast-language:HI;
mso-bidi-language:HI;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
-->
</style>
<br />
<div class="IBMTextStyle1" style="color: #444444;">
<span style="font-family: Calibri; font-size: 14.0pt; mso-ascii-theme-font: major-latin; mso-hansi-theme-font: major-latin;">Some of our
competitors recommend that you use 3rd Normal Form (3NF) for their data
structures, as they believe that is the optimal architecture for the ad hoc
queries that form the basis for decision support and analytical processing of
today. While 3NF can save storage space, it makes queries harder to write, and
slower to execute. A big down side of 3NF for data warehousing is that it
causes the database to join tables for most queries. “Joins” can be a
performance pitfall because they force large volumes of data to be moved around
the system. To speed up these queries, DBAs using these other databases create
and maintain aggregates and/or indexes across tables. In fact, some tables can
have 3, 4, 5 or even more aggregates/ indexes if they are joined to tables
using different columns. It is important to realize that these aggregates/indexes
require knowledge of the queries, reports and analytics that are going to be
run within the system, now and in the future. </span></div>
<div class="IBMTextStyle1" style="color: #444444;">
<span style="font-family: Calibri; font-size: 14.0pt; mso-ascii-theme-font: major-latin; mso-hansi-theme-font: major-latin;">Think of it
this way—if you are heading out for a Sunday drive, and have no destination in
mind, how can you use a navigation system to give you directions?</span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span style="font-family: Calibri; font-size: 14.0pt; mso-ascii-theme-font: major-latin; mso-hansi-theme-font: major-latin;">Another
issue that many of our competitors’ customers report is that they need to
create a duplicate copy of their data in a dimensional model in order to meet
their desired response times. In many cases this dimensional model will contain
many star schemas, as well as a number of copies of the fact tables containing
different levels of data. The issue with this approach is that the application
developer and the business users must be fully aware of what data these new tables
and aggregates really contain. If they aren’t aware, they can inadvertently
make a business decision based on an old snapshot of the data, or a small,
skewed sample of the data. In addition, if a user mistakenly picks the wrong
“table,” that query might take 10 or even 100 times longer to run that it would
if they completely understood the model.<span class="IBMsup"><span style="font-family: Calibri; mso-ansi-font-size: 14.0pt; mso-ascii-theme-font: major-latin; mso-bidi-font-family: "Times New Roman"; mso-bidi-theme-font: minor-bidi; mso-hansi-theme-font: major-latin;"></span></span></span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="IBMTextStyle1" style="color: #444444;">
<span style="font-family: Calibri; font-size: 14.0pt; mso-ascii-theme-font: major-latin; mso-hansi-theme-font: major-latin;">Because IBM
Netezza appliances do not need indexes or pre-computed aggregates to perform
well, there is no need to tune the data model for IBM Netezza appliances. In
fact, many customers simply copy the data model directly from their old data
mart/warehouse or from their transactional system into the IBM Netezza
appliance and leave it as-is. They then simply load a single copy of the data
and start running their queries.</span></div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com4tag:blogger.com,1999:blog-15757447.post-67838928775542452672012-07-11T00:25:00.001-04:002012-07-11T09:12:32.478-04:00Why Analytics is like Wine Tasting<style>
<!--
/* Font Definitions */
@font-face
{font-family:"MS 明朝";
panose-1:0 0 0 0 0 0 0 0 0 0;
mso-font-charset:128;
mso-generic-font-family:roman;
mso-font-format:other;
mso-font-pitch:fixed;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:"MS 明朝";
panose-1:0 0 0 0 0 0 0 0 0 0;
mso-font-charset:128;
mso-generic-font-family:roman;
mso-font-format:other;
mso-font-pitch:fixed;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536870145 1073743103 0 0 415 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
-->
</style>
<br />
<div class="MsoNormal" style="color: #444444;">
I mentioned yesterday that I was in the Finger Lakes last
week. Well, we stopped by some wineries while we were there and it is always
interesting to read the tasting notes on the back of the bottle, or on the
tasting sheet that the winery gives to you. </div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
I was thinking last night about this and how great it would
be if all of the data we, as an organization, create or consume came with its
own “tasting notes”. Just imagine a new
set of transactions arriving from your OLTP systems, and they come with a tag that
says something like “This data shows a correlation between the purchase of
steaks and seasoning salt.” Wouldn’t that make the job of the data scientist /
data analyst so much easier?</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
We also went to one winery in particular, and noted that the
wine maker did not have any tasting notes, and only described his wine as “Like
your favorite pair of slippers” or something like that. After talking about
this for a while, we found that we actually liked this approach better. Rather
than tasting and searching for what the wine maker told us he or she tasted, we
were able to develop our own impression, and detect tastes on our own. Without
being directed to a particular smell or taste, we used our own nose and palette
to decide what we tasted, and what we liked. In the end we bought more bottles
from this winery than we did from any of the other wineries that we visited.</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
You might be scratching your head and wonder where I am
going here, so let me explain. I believe that analytics needs to be more like
the second case above. You should not start with any preconceived notions on
your data based on what others tell you. Analyze the data, detect
correlations/patterns/trends on your own, and then check the tasting notes if
you want to. </div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
The goal of analytics
should be to find NEW information that you can act upon, not simply find the
same thing that someone else already found.</div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com0tag:blogger.com,1999:blog-15757447.post-91829366050744506862012-07-10T09:25:00.002-04:002012-07-10T09:25:57.878-04:00IBM's Big Data Platform - Saving One Life at a Time<style>
<!--
/* Font Definitions */
@font-face
{font-family:"MS 明朝";
panose-1:0 0 0 0 0 0 0 0 0 0;
mso-font-charset:128;
mso-generic-font-family:roman;
mso-font-format:other;
mso-font-pitch:fixed;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:"MS 明朝";
panose-1:0 0 0 0 0 0 0 0 0 0;
mso-font-charset:128;
mso-generic-font-family:roman;
mso-font-format:other;
mso-font-pitch:fixed;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
-->
</style>
<br />
<div class="MsoNormal" style="color: #444444;">
Having been working on parts of IBM’s Big Data platform for
the past year or more, I am continually impressed with the value that IBM
brings to our clients. </div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
When we talk Big Data at IBM, we talk about the three V’s:
Variety, Velocity, and Volume.</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<b style="mso-bidi-font-weight: normal;"><span lang="EN-CA" style="mso-ansi-language: EN-CA;">Volume</span></b><span lang="EN-CA" style="mso-ansi-language: EN-CA;"> is pretty simple. We all understand that we</span>’<span lang="EN-CA" style="mso-ansi-language: EN-CA;">re going from </span>the<span lang="EN-CA" style="mso-ansi-language: EN-CA;"> terabytes to petabytes and into a
zettabytes world. I think most of us understand today just how much data is out
there now and what</span>’<span lang="EN-CA" style="mso-ansi-language: EN-CA;">s
coming over the next few years.</span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span lang="EN-CA" style="mso-ansi-language: EN-CA;">The <b style="mso-bidi-font-weight: normal;">variety</b> aspect is something kind of new
to us in the data warehousing world, and it means that analytics are no longer
just be for structured data, and on top of that, analytics on structured data
doesn’t have to be in a traditional database any longer. The Big Data era is characterized
by the absolute need and desire to explore and analyze all of the data that
organization produce. Because most of the data we produce today is
unstructured, we need to fold in unstructured data analytics as well as
structured. </span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span lang="EN-CA" style="mso-ansi-language: EN-CA;">If you look
at a Facebook post or a Tweet, they may come in a structured format (JSON), but
the true value, and the part we need to analyze, is in the unstructured part.
And that unstructured part is the text of your tweet or your Facebook status/post.</span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span lang="EN-CA" style="mso-ansi-language: EN-CA;">Finally,
there</span>’<span lang="EN-CA" style="mso-ansi-language: EN-CA;">s <b style="mso-bidi-font-weight: normal;">velocity</b>. We at IBM consider velocity
as being <i>how fast the data arrives at the enterprise</i>, and of course, it</span>’<span lang="EN-CA" style="mso-ansi-language: EN-CA;">s going to lead to the question, and
<i>how long does it take you to analyze it and act on it</i>?</span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
It is important to keep in mind that a Big Data problem
could involve only one of these characteristics, or all of them. And in fact,
most of our clients see that a closed loop mechanism, normally involving more
than one of our Big Data solutions, is the best way to tackle their problem. </div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
The neonatal ward at a well known Hospital is a prime
example of this. Hospital equipment issues an alert when a vital sign goes out
of range – prompting the hospital staff to take action immediate.<span style="mso-spacerun: yes;"> </span>However many life threatening conditions take
hours or days to reach critical levels, delaying possible life saving
treatments. Often signs that something is wrong begin to appear long before the
situation becomes serious enough to trigger an alert, and even a skilled nurse
or physician might not be able to spot and interpret these trends in time to
avoid serious complications. Complicating this is the fact that many of these
warning indicators are hard to detect and it’s next to impossible to understand
their interaction and implications until a threshold has been breached. </div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
For example, nosocomial infection, a life threatening
illness contracted in hospitals. Research has shown that signs of this
infection can appear 12-24 hours before overt trouble/distress is spotted and
normal ranges exceeded. Making things more complex, in a baby where this
infection has set in, heart rates stay completely normal (i.e. it doesn’t rise
and fall throughout the day like it does for a healthy baby). In addition, the
pulse also stays within acceptable limits. The information needed to detect the
information is present, it is very subtle and hard to detect. In a neonatal
ward, the ability to absorb and reflect upon all of the data being presented is
beyond human capacity, there is just too much data. </div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
By analyzing historical data, and developing correlations
and understanding of the indicators of this and other heath conditions, the
Doctors and researchers were able to develop a set of rules (or set of
conditions) that indicate a patient is suffering from a specific malady, like nosocomial
infection. The monitors (which can produce 1,000+ reading per second) feed
their reading into IBM’s InfoShpere Streams where it is checked on the fly. The
data is checked against healthy ranges, and also against other values for the
past 72 hours, and if there are any rules that are breached, an alert is
generated. For example, if a child’s heart rate has not changed for the past 4
hours and their temperature is above 99 degrees, then that is a good indicator
that they may be suffering from nosocomial infection.</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
And as the researchers continue to study more and more historical
data in their data warehouse and Hadoop clusters, when they detect more
correlations, they can dynamically update the rules that are being checked on
the real time streaming data.</div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com1tag:blogger.com,1999:blog-15757447.post-80372905841989872992012-07-09T11:56:00.004-04:002012-07-09T11:56:38.789-04:00Indexes do NOT make a warehouse agile<style>
<!--
/* Font Definitions */
@font-face
{font-family:Arial;
panose-1:2 11 6 4 2 2 2 2 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536859905 -1073711037 9 0 511 0;}
@font-face
{font-family:"MS 明朝";
mso-font-charset:78;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536870145 1791491579 18 0 131231 0;}
@font-face
{font-family:"MS 明朝";
mso-font-charset:78;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536870145 1791491579 18 0 131231 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536870145 1073743103 0 0 415 0;}
@font-face
{font-family:"Arial Unicode MS";
panose-1:2 11 6 4 2 2 2 2 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-134238209 -371195905 63 0 4129279 0;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
p.IBMTextStyle1, li.IBMTextStyle1, div.IBMTextStyle1
{mso-style-name:IBM_TextStyle1;
mso-style-unhide:no;
mso-style-parent:"";
margin-top:.2in;
margin-right:0in;
margin-bottom:0in;
margin-left:0in;
margin-bottom:.0001pt;
mso-pagination:none;
mso-hyphenate:none;
font-size:10.0pt;
mso-bidi-font-size:12.0pt;
font-family:Arial;
mso-fareast-font-family:"Arial Unicode MS";
mso-bidi-font-family:Tahoma;
mso-font-kerning:.5pt;
mso-fareast-language:HI;
mso-bidi-language:HI;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
-->
</style>
<br />
<div class="MsoNormal" style="color: #444444;">
<span style="font-family: Arial; font-size: 10.0pt;">I took a
few days off to visit the Finger Lakes in New York (you really should go there
if you like hiking and/or wine) and came back to an overflowing email inbox.
Some of these emails were from clients that have been receiving more
correspondence from our competitors with claims of their superiority over IBM
Netezza. </span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span style="font-family: Arial; font-size: 10.0pt;">One of
these claims was that their solution is more nimble and able to handle broader
workloads because they have indexes and aggregates. This one made me think for
a few minutes, but I still feel that the Netezza approach where there is no
need for indexes is still a far better solution.</span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span style="font-family: Arial; font-size: 10.0pt;">While an
index or aggregate can be used to improve/optimize performance for one or more
queries, the upfront table, aggregate, and index design/build phase will cause
other systems to take MANY TIMES longer to get up and running efficiently than
IBM Netezza appliances. In fact, some of our competitors’ customers have openly
talked about months long implementation cycles, while IBM Netezza customers
talk about being up and running in 24 hours…</span></div>
<div class="IBMTextStyle1" style="color: #444444;">
<span style="mso-bidi-font-family: Arial; mso-bidi-font-size: 10.0pt;">Instead of days or weeks of planning their data models, IBM Netezza
appliance customers simply copy their table definitions from their existing
tables, load the data, and start running their queries/reports/analytics. There
is absolutely no need to create any indexes (and then have to choose between up
to 19 different types of indexes) or aggregates. Where other data warehouse
solutions require weeks of planning, IBM Netezza appliances are designed to
deliver results almost immediately. </span></div>
<div class="IBMTextStyle1" style="color: #444444;">
<span style="mso-bidi-font-size: 10.0pt;">Today’s data
warehouse technologies made it possible to collect and merge very large amounts
of data. Systems that require indexes are fine for creating historical reports
because you simply run the same report over and over again. But today’s
business users need answers promptly. The answer to one question will determine
the next question that they are going to ask, and that answer the next, and so
on. This thought process is known as “train of thought” analysis, and this can
lead to competitive advantages required in the economy of today and tomorrow. </span></div>
<div class="IBMTextStyle1" style="color: #444444;">
<span style="mso-bidi-font-size: 10.0pt;">Outside of IBM
Netezza data warehouse appliances, standard operating procedure is for users to
extract a small sample of data, move it out of the data warehouse to another
server, and then run the analytics against that sample. <span style="mso-spacerun: yes;"> </span>This is required because the systems cannot
support these ad-hoc analytic reports without completely exhausting the system
resources, and impacting all other users. Even if these other systems had the
right indexes all of the time, they would still need to move massive amounts of
data into memory before processing it. This has led to users with other data warehouse
solutions sampling their data and copying a small sample to a dedicated
analytics server. </span></div>
<div class="IBMTextStyle1" style="color: #444444;">
<span style="mso-bidi-font-size: 10.0pt;">The small sample
size allows the analysis to complete in a reasonable amount of time, but by
restricting this analysis to a small subset of the data, it becomes harder to
spot (and act on) the trends found within it.<span style="mso-spacerun: yes;">
</span>We discussed this above with the baseball example, but it applies to everyone.
Credit cards are another example, with credit card numbers and identities being
stolen every day, the card companies need to detect these misuses immediately
in order to limit their liability and prevent loss. While there are quick
“indicators” of fraud, like a new credit card being used at a pay phone at an
airport for the first time, most indicators come from correlating more than one
transaction. For example, a card cannot be used in Kansas and then in Orlando 7
minutes later, unless one of the transactions is a web transaction or the card
number was manually entered because it was taken over the phone. So, if a card
was physically swiped in Kansas and then in Orlando less than a few hours
later, the account must have been compromised. Now, if the fraud detection
application only looked at every 10, or 100, transactions, they would miss at
least one, if not both, of these transactions most of the time.</span></div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com0tag:blogger.com,1999:blog-15757447.post-10405259918586612122012-07-03T10:12:00.000-04:002012-07-03T10:13:33.026-04:00Why should compression only work for read-only data?<style>
<!--
/* Font Definitions */
@font-face
{font-family:"MS 明朝";
mso-font-charset:78;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:"MS 明朝";
mso-font-charset:78;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-520092929 1073786111 9 0 415 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536870145 1073743103 0 0 415 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
-->
</style><br />
<div class="MsoNormal" style="color: #444444;">
A number of our competitors make bold compression claims,
like “we provide 4X, or even 10X+ compression”. What they do not tell you is
that you have to choose between multiple different compression levels, and/or
compression libraries/types. They also do not mention that you cannot use their
compression on tables that have inserts, updates, and/or deletes occurring. Nor
do they mention the overhead that you can expect to see if you turn on their
compression.</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
Let’s look at these three points in a little more detail. </div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
In today’s world of reduced
budgets, one of the easiest ways to save money with a data warehouse is to
reduce the amount of disk space required to store the data. To this end, nearly
all data warehouse solutions offer some form of database compression. In order
to use compression with many of our competitors the table must be an
Append-only table. </div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
Append-only tables have the following limitations:</div>
<div class="MsoNormal" style="color: #444444;">
•Cannot UPDATE rows in an append-only table</div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
•Cannot
DELETE rows from an append-only table</div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
•Cannot
ALTER TABLE...ADD COLUMN to an append-only table</div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
•Cannot
add indexes to an append-only table.</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
These limitations are because
of the way these vendors have implemented their ‘database compression’. While
Netezza has built in algorithms specifically designed for database usage,
others uses a compression library that “compresses” the data file as it is
being written to disk, and then uses the same library to un-compress the file
as it reads it from disk. For anyone that has used a tool like gzip, WinZip,
pkzip, WinRar, etc. you all know how slow these tools are, and how much CPU
cycles they use. This is the same consideration and overhead you will have with
these other vendors if you use their compression. In fact this overhead can be
so bad that some customers who have presented at our competitors’ conferences
have talked about tests where a single query running on a table with
compression used up over 95% of the CPU, while the same query against the same
data in a table that was not compressed used less than 5% of the CPU.</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
On top of the performance impact, there is also the DBA
overhead. With one competitor the DBA has to choose between 3 types of compression (i.e.
compression libraries) and 9 different levels of compression, each of which
work better for different data types. That is 27 different
combinations/permutations that the DBA has to choose between, for each table.</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
With
IBM Netezza compression is always on, there is no “better algorithm” for
different tables, and because of the way the Netezza architecture works, when
you get 4X compression with your data in Netezza, you see an associated 4X
improvement in performance, for all types of workloads, not just reads. </div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com0tag:blogger.com,1999:blog-15757447.post-74689089618262901442012-07-02T09:23:00.000-04:002012-07-02T09:23:37.493-04:00Addressing more crazy competitor claims<style>
<!--
/* Font Definitions */
@font-face
{font-family:"MS 明朝";
mso-font-charset:78;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:"MS 明朝";
mso-font-charset:78;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536870145 1073743103 0 0 415 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS 明朝";
mso-bidi-font-family:"Times New Roman";}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
-->
</style>
<br />
<div class="MsoNormal" style="color: #444444;">
Among some of the other “claims”
that our competitor made about Netezza is that is can only load at the rate of
2TB/hr. First off, this is false. The current generation of the Netezza
platform can load at over 5TB/hr. But, the real question I ask is <span style="background-color: blue;"></span><span style="color: blue;">"Does this really matter after you have your system up and
running?”</span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
After the initial loading of the
database from the existing system(s), very few companies load more than a
couple hundred GB to a couple TB per day, and most do not even approach these
daily or even monthly load volumes. Even Netezza’s biggest customers who have
PetaByte sized systems do not find Netezza’s load speed to be an issue. </div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
Now let’s look at the claims this
competitor is making in more detail, and peel back the layers of the onion. <span style="mso-spacerun: yes;"> </span>This competitor claims that they can load at
double the Netezza’s load speed of 5TB/hr. But they leave out a number of
important factors when they make this claim.</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<b style="mso-bidi-font-weight: normal;">What about compression?</b></div>
<div class="MsoNormal" style="color: #444444;">
Netezza can load at a rate of
5TB/hr and compress the data at the same time. This competitor can only load at
their claimed compression rate if compression is not used. So, if you want to
compress the data, how fast can you really load on their platform?<span style="mso-spacerun: yes;"> </span>They use a library based compression
algorithm that uses CPU cycles to basically “zip” the data pages as they are
written to disk, using significant CPU cycles in the system that cannot then be
used to format the data into pages, build indexes, etc. </div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<b style="mso-bidi-font-weight: normal;">What about partitioned tables?</b></div>
<div class="MsoNormal" style="color: #444444;">
This competitor needs tables to be
partitioned in order to provide good performance, but in order to load a table
this competitor has to have a “rule” for each data partition, and then each row
that is being loaded must be compared to the rules to know which partition it
should be loaded into. If the row should be loaded into one of the first couple
of ranges, then there is little extra processing, but all of the latest data
will have to be checked against many rules, slowing down the processing of
these rows, and definitely slowing down the load process.</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<b style="mso-bidi-font-weight: normal;">What about indexes?</b></div>
<div class="MsoNormal" style="color: #444444;">
This competitor admits in their
manuals that they also need indexes in order to perform well. But, each index
incrementally slows down load performance. </div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
Netezza does not need indexes to
perform well, so does not suffer from decreased load speed because of indexes,
or table partitioning</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<b style="mso-bidi-font-weight: normal;">What about pre-processing?</b></div>
<div class="MsoNormal" style="color: #444444;">
Netezza can load at the same 5TB/hr
rate with no pre-processing of the input data file. This same competitor can
only load at their claimed faster rate if their appliance includes an option
“integration” or ETL module where the servers pre-process the data and then
send it to the data modules to be loaded. Without the integration module, the
load file would need to be placed on the shared file system (accessible from
all modules in their appliance) and then the load speed is really only 2TB/hr
based on published validation reports of their architecture and procedures. And
again, this 2TB/hr is without compression, or table partitioning.</div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com2tag:blogger.com,1999:blog-15757447.post-2512312130814101322012-06-29T07:53:00.001-04:002012-06-29T07:55:01.318-04:00Uncovering the truth about more outrageous competitor claims<style>
<!--
/* Font Definitions */
@font-face
{font-family:"MS 明朝";
mso-font-charset:78;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:"MS 明朝";
mso-font-charset:78;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536870145 1073743103 0 0 415 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS 明朝";
mso-bidi-font-family:"Times New Roman";}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
-->
</style>
<br />
<div class="MsoNormal" style="color: #444444;">
Another
of the claims this competitor made is that Netezza cannot handle the data ingest
from a point of sale (POS) type system because so it could not handle the data
being sent from the hundreds or thousands of POS systems at the same time. They
go on to claim that Netezza cannot handle more than a specific, ridiculously
small, number of concurrent writes to try to give credence to this argument.</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
In my opinion,
this point shows a lack of knowledge of real data warehousing and analytics.
IBM Netezza has a large number of retail customers who feed their POS data into
Netezza all the time. But, this data normally always comes into the data center
in some non-database type of communication protocol. The data is then extracted
from these POS feeds, and has meta data management and identity assertion
algorithms applied against it, because the data may be coming from many
different stores, even different “named” stores where the same item may have
different SKUs. Only then is the cleansed data loaded into the warehouse, it is
not loaded directly from the hundreds/thousands of POS applications/registers.</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
IBM
Netezza absolutely supports trickle feed and real/near-real time updates from
this type of data stream process, as well as direct replication from other
relational databases.</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
And, if
you are looking for the ultimate in real time reporting and analytics on your
POS data, IBM has the system for you. The IBM DB2 Analytics Accelerator is an
IBM Netezza system connected directly to a DB2 for z/OS system using the
zEnterprise connection. In this configuration, the transactional applications
still run against the tried and true DB2 for z/OS system, and
reporting/analytic queries get transparently routed through the DB2 for z/OS
system to the Netezza system, to offload the processing and resource usage, and
ultimately run much faster. DB2 for z/OS systems run many of the world’s largest
scale OLTP applications, and this brings them the power of real time analytics
without the need to create extra indexes, aggregates, etc. in their DB2 for
z/OS system which are needed to allow the reports/analytics to run quickly
enough, but also have a detrimental effect on the transactional performance. </div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com0tag:blogger.com,1999:blog-15757447.post-9946586107076712372012-06-28T16:09:00.002-04:002012-06-28T16:26:53.283-04:00FUD Competitors are Spreading on Netezza<style>
<!--
/* Font Definitions */
@font-face
{font-family:"MS 明朝";
mso-font-charset:78;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:"MS 明朝";
mso-font-charset:78;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536870145 1073743103 0 0 415 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-ascii-theme-font:minor-latin;
mso-fareast-font-family:"MS 明朝";
mso-fareast-theme-font:minor-fareast;
mso-hansi-font-family:Cambria;
mso-hansi-theme-font:minor-latin;
mso-bidi-font-family:"Times New Roman";
mso-bidi-theme-font:minor-bidi;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
-->
</style>
<br />
<div class="MsoNormal" style="color: #444444;">
Recently I was made aware of some FUD (fear, uncertainty,
and doubt) that a competitor has been sending to our current and prospective
clients. This FUD contained a number of gross inaccuracies, as well as some “points”
that really made me scratch my head and wonder how much this competitor really
understands data warehousing and analytics.</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
This competitor claimed that Netezza scanned the entire
table for all SQL / Analytic operations. </div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
This claim is absolutely not true. While
Netezza does not have indexes that the DBA must create and maintain, it does
automatically build and maintain zone maps for all tables in the database.
These zone maps contain the minimum and maximum value for all columns in every
extent within each table. So, before the query starts reading from disk, it
looks at the predicates in the query, and compares them to the zone maps to
determine which table extents can be skipped and which need to be read. </div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
For example, if you want to calculate
the total sales of Red Ford Mustangs in June 2011, Netezza can skip any table extent
that does not have data for June 2011. So, for a database with 7 years of sales
history, it can skip any extent that has a maximum that is less, or a minimum
that is greater than, June 2011. This eliminates 98% or more of the I/O
required.<br />
<br />
Our competitor claims that their range partitioning would automatically eliminate processing on all of the months other than June 2011 and is a better solution. While their range partitioning will eliminate the I/O like Netezza, there is a whole bunch of effort that partitioning brings to their solution that they do not talk about. In their solution you create a table, and then you create "inheritance children", one per partition. So for a table with 7 years of data, that is 84 monthly partitions, and 84 tables (the base table plus the 83 inheritance children). That might not seem too bad, but there's more. If you have a primary key, foreign key, index, constraint, or permission on the table, you need to apply it to the table and each of its inheritance children, it is not a global operation. So, for these 84 tables with 3 user groups with different permissions, a primary key, a constraint, and one non-unique index, that would be 84 * (3 + 1 + 1 + 1) or 504 DDL statements to set this up, and to maintain over time.<br />
<br />
And on top of that, their bulk loader is not partition aware, so you need to write a rule for each table/inheritance child, adding 84 more DDL statements to the list.<br />
<br />
In Netezza you write one statement to create the table, vs. 588 DDL statements for the exact same table and data in this competitor.</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
I’ll respond to some more of the
claims this competitor has been making over my next few posts.</div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com3tag:blogger.com,1999:blog-15757447.post-91028422143410861102012-05-20T18:15:00.002-04:002012-05-31T18:32:30.441-04:00Argumentative Colleagues and IBM Netezza reducing runtime from 7 hours to 8 seconds....<div class="MsoNormal" style="color: #444444;">
I had an “interesting discussion” with someone during my IBM
Netezza Futures presentation last week at the IDUG (International DB2 User’s
Group) conference. At the end of the presentation, one of my IBM colleagues was
trying to argue that Netezza’s streaming architecture must not be able to
handle multi-table joins because “it does all of its work in the FPGA”. I tried to explain that he was incorrect, and the way that Netezza does
joins so efficiently, but my colleague didn’t seem to listen, and asked the same thing again.
</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
Although some people reading my post might think that I am
writing this to try to explain to my IBM colleagues how they should act in
customer events, I am not. </div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
The best part of this discussion was when my colleague asked
the same question a second time, one of our customers stood up and said “What
Dwaine said about the performance of IBM Netezza is exactly right”. The
customer then went on to say how impressed his company is with the proof of
concept (PoC) they just completed with the IBM DB2 Analytics Accelerator. I will explain the IBM DB2 Analytics Accelerator soon, but what the customer went on to say is
that they have queries that were taking 7 hours on their DB2 for z/OS system (and
using MIPS all that time) that are now running on the IBM DB2 Analytics Accelerator in 8 seconds and
using basically no MIPS. I could not have paid for a better ending to my
session.</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
The <a href="http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=2&ved=0CHsQFjAB&url=http%3A%2F%2Fwww.redbooks.ibm.com%2Fredpieces%2Fpdfs%2Fsg248005.pdf&ei=eGy5T9v2F4aA6gHF5cjLAw&usg=AFQjCNE3kRi6SZsD9OTna3ar2Co0gUe_7w" target="_blank">IBM DB2 Analytics Accelerator</a> is an IBM Netezza 1000 system piggy backing along side a
DB2 for z/OS system. The DB2 for z/OS optimizer will offload large, complex
queries from the DB2 system onto the IBM DB2 Analytics Accelerator, much like a materialized view or
materialize query table, but keep the short transactional queries running on
DB2 for z/OS. </div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
So with absolutely no change to their application, data
loading procedures, or any extra tuning, this customer was able to run their
analytics over 3,000 times faster. That’s the power of the IBM Netezza
appliance and the IBM DB2 Analytics Accelerator.</div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
And, it would still be nice if my IBM colleagues learned how
to act at customer events. </div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com0tag:blogger.com,1999:blog-15757447.post-64730693186691966172012-05-15T10:06:00.000-04:002012-05-15T10:06:09.367-04:00Increasing Profits with the "Best Offer"<style>
<!--
/* Font Definitions */
@font-face
{font-family:Arial;
panose-1:2 11 6 4 2 2 2 2 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:Arial;
panose-1:2 11 6 4 2 2 2 2 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:"MS ??";
panose-1:0 0 0 0 0 0 0 0 0 0;
mso-font-charset:128;
mso-generic-font-family:auto;
mso-font-format:other;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoFootnoteText, li.MsoFootnoteText, div.MsoFootnoteText
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-link:"Footnote Text Char";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
span.MsoFootnoteReference
{mso-style-priority:99;
mso-style-unhide:no;
font-family:"Times New Roman";
mso-bidi-font-family:"Times New Roman";
vertical-align:super;}
span.FootnoteTextChar
{mso-style-name:"Footnote Text Char";
mso-style-priority:99;
mso-style-unhide:no;
mso-style-locked:yes;
mso-style-link:"Footnote Text";
mso-ansi-font-size:12.0pt;
mso-bidi-font-size:12.0pt;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-size:11.0pt;
mso-ansi-font-size:11.0pt;
mso-bidi-font-size:11.0pt;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-hansi-font-family:Cambria;}
/* Page Definitions */
@page
{mso-footnote-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0clip_header.htm") fs;
mso-footnote-continuation-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0clip_header.htm") fcs;
mso-endnote-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0clip_header.htm") es;
mso-endnote-continuation-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0clip_header.htm") ecs;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
-->
</style>
<br />
<div class="MsoNormal" style="color: #444444; line-height: 141%; margin-right: 8.15pt;">
<span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 141%;">My colleague <a href="http://thinking.netezza.com/blogs_by/james-kobielus" target="_blank">James Kobielus</a> has been talking about
“next best” action recently</span><a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftn1" name="_ftnref1" style="mso-footnote-id: ftn1;" title=""><span class="MsoFootnoteReference"><span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 141%;"><span style="mso-special-character: footnote;"><span class="MsoFootnoteReference"><span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt;">[1]</span></span></span></span></span></a><a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftn2" name="_ftnref2" style="mso-footnote-id: ftn2;" title=""><span class="MsoFootnoteReference"><span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 141%;"><span style="mso-special-character: footnote;"><span class="MsoFootnoteReference"><span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt;">[2]</span></span></span></span></span></a><span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 141%;">, and I also talked about this in my
post on the importance of agility for analytic applications</span><a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftn3" name="_ftnref3" style="mso-footnote-id: ftn3;" title=""><span class="MsoFootnoteReference"><span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 141%;"><span style="mso-special-character: footnote;"><span class="MsoFootnoteReference"><span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt;">[3]</span></span></span></span></span></a><span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 141%;">. I have been talking to a number of
customers recently who want to take this beyond next best, to <b style="mso-bidi-font-weight: normal;">the best offer</b>.</span></div>
<div class="MsoNormal" style="color: #444444; line-height: 141%; margin-right: 8.15pt;">
<br /></div>
<div class="MsoNormal" style="color: #444444; line-height: 141%; margin-right: 8.15pt;">
<span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 141%;">In my blog I talked about a person who had
made a number of purchases, and the retailer was trying to influence the
customers next purchase by providing them with a coupon for an item that they
might be interested in based on their purchasing history. But, how much more
could a company make if they could influence their customers’ purchases before they
are made, pushing them to more profitable items during the ordering process.</span></div>
<div class="MsoNormal" style="color: #444444; line-height: 141%; margin-right: 8.15pt;">
<br /></div>
<div class="MsoNormal" style="color: #444444; line-height: 141%; margin-right: 8.15pt;">
<span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 141%;">Think of a distributor of auto parts as an
example. As the body shops and garages are placing orders, wither online or
over the phone, as they enter an item’s description or SKU, what if you could
offer a different part, that has the same specifications and same look and feel,
but it costs less, and has a higher profit margin for you. Well, that would be
a win-win situation, the garage gets a less expensive part that they can sell
to the customer for less (like this would really happen, right?) but the
distributor also makes a higher profit. </span></div>
<div class="MsoNormal" style="color: #444444; line-height: 141%; margin-right: 8.15pt;">
<br /></div>
<div class="MsoNormal" style="color: #444444; line-height: 141%; margin-right: 8.15pt;">
<span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 141%;">This take more than just a data warehouse /
analytic application. And this type of example is where IBM is uniquely
positioned to help you out. You cannot build this “system” with just a data
warehouse. </span></div>
<div class="MsoNormal" style="color: #444444; line-height: 141%; margin-right: 8.15pt;">
<br /></div>
<div class="MsoNormal" style="color: #444444; line-height: 141%; margin-right: 8.15pt;">
<span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 141%;">You will need an analytics warehouse that can
determine the most profitable items. You may need IBM InfoSphere BigInsights to examine
your parts catalogs to find which parts have the same specifications and can be
substituted for each other. You will probably need a rules storage mechanism
that will record the compatible items from BigInsights and also from your
internal sales team who have the deep knowledge of the items they sell. Then
you need to have both your online ordering system and your internal order entry
system must be intelligent enough to pop-up an offer whenever it sees one of the
item numbers or SKUs that have been identified as "replaceable".</span></div>
<div class="MsoNormal" style="color: #444444; line-height: 141%; margin-right: 8.15pt;">
<br /></div>
<div class="MsoNormal" style="color: #444444; line-height: 141%; margin-right: 8.15pt;">
<span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 141%;">While you might be able to call a customer
back if you can save them thousands of dollars or more, normally these offers
need to be made as the order is being entered/taken, not afterwards. </span></div>
<div class="MsoNormal" style="color: #444444; line-height: 141%; margin-right: 8.15pt;">
<br /></div>
<div class="MsoNormal" style="color: #444444; line-height: 141%; margin-right: 8.15pt;">
<span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 141%;">Bring the power if the IBM Big Data family
and our other Information Management and WebSphere solutions to your business,
and drive more profit.</span></div>
<div style="mso-element: footnote-list;">
<br clear="all" />
<hr align="left" size="1" width="33%" />
<div id="ftn1" style="mso-element: footnote;">
<div class="MsoFootnoteText">
<a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftnref1" name="_ftn1" style="mso-footnote-id: ftn1;" title=""><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8.0pt;"><span style="mso-special-character: footnote;"><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8.0pt; mso-ansi-language: EN-US; mso-bidi-language: AR-SA; mso-fareast-font-family: "MS ??"; mso-fareast-language: EN-US;">[1]</span></span></span></span></span></a><span style="font-size: 8.0pt;">
<span style="color: #444444;">http://thinking.netezza.com/blog/next-best-action-healthcare-save-improve-lives-through-applied-analytics</span></span></div>
</div>
<div id="ftn2" style="color: #444444;">
<div class="MsoFootnoteText">
<a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftnref2" name="_ftn2" style="mso-footnote-id: ftn2;" title=""><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8.0pt;"><span style="mso-special-character: footnote;"><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8.0pt; mso-ansi-language: EN-US; mso-bidi-language: AR-SA; mso-fareast-font-family: "MS ??"; mso-fareast-language: EN-US;">[2]</span></span></span></span></span></a><span style="font-size: 8.0pt;">
http://thinking.netezza.com/blog/next-best-action-smarter-planet-think-global-optimize-local</span></div>
</div>
<div id="ftn3" style="color: #444444;">
<div class="MsoFootnoteText">
<a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftnref3" name="_ftn3" style="mso-footnote-id: ftn3;" title=""><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8.0pt;"><span style="mso-special-character: footnote;"><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8.0pt; mso-ansi-language: EN-US; mso-bidi-language: AR-SA; mso-fareast-font-family: "MS ??"; mso-fareast-language: EN-US;">[3]</span></span></span></span></span></a><span style="font-size: 8.0pt;">
http://dsnowondb2.blogspot.com/2012/05/importance-of-agility-for-analytic.html</span></div>
</div>
</div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com0tag:blogger.com,1999:blog-15757447.post-46066747052583039922012-05-14T21:32:00.001-04:002012-05-14T21:32:52.720-04:00Thoughts on "in memory" data warehousing / analytics<style>
<!--
/* Font Definitions */
@font-face
{font-family:Arial;
panose-1:2 11 6 4 2 2 2 2 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536859905 -1073711037 9 0 511 0;}
@font-face
{font-family:Arial;
panose-1:2 11 6 4 2 2 2 2 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536859905 -1073711037 9 0 511 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-536870145 1073743103 0 0 415 0;}
@font-face
{font-family:"MS ??";
panose-1:0 0 0 0 0 0 0 0 0 0;
mso-font-charset:128;
mso-generic-font-family:auto;
mso-font-format:other;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoFootnoteText, li.MsoFootnoteText, div.MsoFootnoteText
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-link:"Footnote Text Char";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
span.MsoFootnoteReference
{mso-style-priority:99;
mso-style-unhide:no;
font-family:"Times New Roman";
mso-bidi-font-family:"Times New Roman";
vertical-align:super;}
span.FootnoteTextChar
{mso-style-name:"Footnote Text Char";
mso-style-priority:99;
mso-style-unhide:no;
mso-style-locked:yes;
mso-style-link:"Footnote Text";
mso-ansi-font-size:12.0pt;
mso-bidi-font-size:12.0pt;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-size:11.0pt;
mso-ansi-font-size:11.0pt;
mso-bidi-font-size:11.0pt;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-hansi-font-family:Cambria;}
/* Page Definitions */
@page
{mso-footnote-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0:clip_header.htm") fs;
mso-footnote-continuation-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0:clip_header.htm") fcs;
mso-endnote-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0:clip_header.htm") es;
mso-endnote-continuation-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0:clip_header.htm") ecs;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
-->
</style>
<br />
<div class="MsoNormal" style="color: #444444; line-height: 104%; margin-right: 6.6pt;">
<span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 104%;">“In
Memory” seems to be the latest buzz term in the database and analytics arena. If
in memory was able to live up to the hype it would be a great thing, but there
is still a lot of hype involved. </span></div>
<div class="MsoNormal" style="color: #444444; line-height: 104%; margin-right: 6.6pt;">
<br /></div>
<div class="MsoNormal" style="color: #444444; line-height: 104%; margin-right: 6.6pt;">
<span style="font-family: Arial; font-size: 10pt; line-height: 104%;">In memory database
vendors claim that “Reporting requirements have a large impact on I/O time and
network resources when dealing with large volumes of data. In order to minimize
this, a company needs optimized file and database access methods. In-memory
overcomes this process by shifting all the data and workload into memory.”</span><span style="font-family: Arial; font-size: 9.5pt; line-height: 104%;"> </span><a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftn1" name="_ftnref1" style="mso-footnote-id: ftn1;" title=""><span class="MsoFootnoteReference"><span style="font-family: Arial; font-size: 9.5pt; line-height: 104%;"><span style="mso-special-character: footnote;"><span class="MsoFootnoteReference"><span style="font-family: Arial; font-size: 9.5pt;">[1]</span></span></span></span></span></a><span style="font-family: Arial; font-size: 9.5pt; line-height: 104%;"></span></div>
<div class="MsoNormal" style="color: #444444; line-height: 104%; margin-right: 6.6pt;">
<br /></div>
<div class="MsoNormal" style="color: #444444; line-height: 104%; margin-right: 6.6pt;">
<span style="font-family: Arial; font-size: 10pt; line-height: 104%;">But this is not the
only way to eliminate the I/O bottleneck that can plague traditional databases
when they are used for data warehousing and analytics. IBM Netezza solves the
I/O bottleneck by pushing the work down to the I/O channel, where it acts on the
data as it comes off disk, and only sends the data that matches the query
across the server inter-connect.</span><span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 104%;"></span></div>
<div class="MsoNormal" style="color: #444444; line-height: 104%; margin-right: 6.6pt;">
<br /></div>
<div class="MsoNormal" style="color: #444444; line-height: 104%; margin-right: 6.6pt;">
<span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 104%;">Because
IBM Netezza operates on the data as it streams off of the disks, it is not
plagued data not fitting in memory. In an in-memory database, the entire
database must fit in memory, and any temporary tables, scratch tables,
overflowed sorts, etc. must also fit entirely within the memory the system has
been configured to use.<span style="mso-spacerun: yes;"> </span>As data volume
grow, and the “warehouse” becomes more and more visible, there will be more
users, and as the number of users increases, the chance that 2, 3, or even 20
or more people will be running queries at the same time, and may be sorting or
ordering data using temporary tables. Or, a new user may point and click their way
around Business Objects and build a huge query that joins 5 or 10 tables. All
of these will cause large temporary tables to be created, all at once,
potentially filling up the memory on the system. </span></div>
<div class="MsoNormal" style="color: #444444; line-height: 104%; margin-right: 6.6pt;">
<br /></div>
<div class="MsoNormal" style="color: #444444; line-height: 104%; margin-right: 6.6pt;">
<span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 104%;">So,
what happens if an in memory databases uses up all of the system memory (RAM)
on a server? Well according to an SAP employee, the system will crash</span><span style="font-size: 10pt; letter-spacing: -0.1pt; line-height: 104%;">.</span><a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftn2" name="_ftnref2" style="mso-footnote-id: ftn2;" title=""><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 10pt; letter-spacing: -0.1pt; line-height: 104%;"><span style="mso-special-character: footnote;"><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 10pt; letter-spacing: -0.1pt;">[2]</span></span></span></span></span></a><span style="font-size: 10pt; letter-spacing: -0.1pt; line-height: 104%;"> </span><span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 104%;"><span style="mso-spacerun: yes;"> </span>Does that seem like a good solution to you?</span></div>
<div class="MsoNormal" style="color: #444444; line-height: 104%; margin-right: 6.6pt;">
<br /></div>
<div class="MsoNormal" style="color: #444444; line-height: 104%; margin-right: 6.6pt;">
<span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 104%;">Because
of issues like this, most in memory databases are used to run reports and/or
analytics on a sample of the data, to restrict the data size to something
manageable and affordable.<span style="mso-spacerun: yes;"> </span>And, as I
explained a couple weeks ago, using data sampling for analytics is a bad idea,
that will severely limit, if not completely eliminate the value you can derive
from your data. Data that you store (some where else, since it cannot fit in
memory) and do not analyze is a liability, only when you analyze your data does
it become an asset.<span style="mso-spacerun: yes;"> </span>IBM Netezza ensures
that all of your data is a business asset that you can derive the most value
from.</span></div>
<div class="MsoNormal" style="color: #444444; line-height: 104%; margin-right: 6.6pt;">
<br /></div>
<div class="MsoNormal" style="color: #444444; line-height: 104%; margin-right: 6.6pt;">
<span style="font-family: Arial; font-size: 10pt; letter-spacing: -0.1pt; line-height: 104%;">There
are a number of other points that I want to make on “in memory” databases, but
I’ll talk about them in my upcoming posts.<span style="mso-spacerun: yes;">
</span></span></div>
<div style="mso-element: footnote-list;">
<br clear="all" />
<hr align="left" size="1" width="33%" />
<div id="ftn1" style="mso-element: footnote;">
<div class="MsoFootnoteText">
<a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftnref1" name="_ftn1" style="mso-footnote-id: ftn1;" title=""><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8.0pt;"><span style="mso-special-character: footnote;"><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8.0pt; mso-ansi-language: EN-US; mso-bidi-language: AR-SA; mso-fareast-font-family: "MS ??"; mso-fareast-language: EN-US;">[1]</span></span></span></span></span></a><span style="font-size: 8.0pt;"> <span style="color: #444444;">In Memory Analytuics, Retrieved 5/14/2012 from
http://www.yellowfinbi.com/Document.i4?DocumentId=104879</span></span></div>
</div>
<div id="ftn2" style="mso-element: footnote;">
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt; mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftnref2" name="_ftn2" style="mso-footnote-id: ftn2;" title=""><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8.0pt; line-height: 104%;"><span style="mso-special-character: footnote;"><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8.0pt; mso-ansi-language: EN-US; mso-bidi-language: AR-SA; mso-fareast-font-family: "MS ??"; mso-fareast-language: EN-US;">[2]</span></span></span></span></span></a><span style="font-size: 8.0pt; line-height: 104%;"> <span style="color: #444444;">SAP Community Network, retrieved
5/14/2012 from </span></span><span style="color: #444444; font-size: 8pt; letter-spacing: -0.1pt; line-height: 104%;">http://forums.sdn.sap.com/thread.jspa?threadID=2125871</span></div>
<div class="MsoFootnoteText">
<br /></div>
</div>
</div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com1tag:blogger.com,1999:blog-15757447.post-26103880204839850982012-05-09T11:34:00.004-04:002012-05-14T16:42:22.217-04:00Come see me at IDUG next week in Denver<div style="color: #444444;">
I will be presenting IBM Netezza futures next week at the IDUG North America conference. Drop by and say Hi.... Visit the <a href="http://www.idug.org/" target="_blank">IDUG Site</a> for more info. </div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com0tag:blogger.com,1999:blog-15757447.post-52529521140737769102012-05-08T09:21:00.001-04:002012-05-08T09:29:57.505-04:00New Paper - Teradata and IBM Netezza Compared<div style="color: #444444;">
Check out this paper comparing Teradata and IBM Netezza.</div>
<br />
<a href="https://www14.software.ibm.com/webapp/iwm/web/signup.do?source=sw-infomgt&S_PKG=500026035" target="_blank">Click here to download the paper</a>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com0tag:blogger.com,1999:blog-15757447.post-43012148818247756252012-05-04T08:15:00.001-04:002012-05-04T08:15:17.681-04:00It's Time to End Node Rage<div style="color: #444444;">
Check out this paper and the videos to see why IBM Netezza appliance help "End Node Rage"</div>
<br />
<a href="http://www.netezza.com/noderage/" target="_blank">End Node Rage</a>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com0tag:blogger.com,1999:blog-15757447.post-27963074283138539032012-05-03T19:29:00.000-04:002012-05-03T19:48:01.948-04:00Performance in an Ad-Hoc Environment<style>
<!--
/* Font Definitions */
@font-face
{font-family:Arial;
panose-1:2 11 6 4 2 2 2 2 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:"Courier New";
panose-1:2 7 3 9 2 2 5 2 4 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;
mso-font-charset:2;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:0 268435456 0 0 -2147483648 0;}
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;
mso-font-charset:2;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:0 268435456 0 0 -2147483648 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:"MS ??";
panose-1:0 0 0 0 0 0 0 0 0 0;
mso-font-charset:128;
mso-generic-font-family:auto;
mso-font-format:other;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoFootnoteText, li.MsoFootnoteText, div.MsoFootnoteText
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-link:"Footnote Text Char";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
span.MsoFootnoteReference
{mso-style-priority:99;
mso-style-unhide:no;
font-family:"Times New Roman";
mso-bidi-font-family:"Times New Roman";
vertical-align:super;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-qformat:yes;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoListParagraphCxSpFirst, li.MsoListParagraphCxSpFirst, div.MsoListParagraphCxSpFirst
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoListParagraphCxSpMiddle, li.MsoListParagraphCxSpMiddle, div.MsoListParagraphCxSpMiddle
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoListParagraphCxSpLast, li.MsoListParagraphCxSpLast, div.MsoListParagraphCxSpLast
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
span.FootnoteTextChar
{mso-style-name:"Footnote Text Char";
mso-style-priority:99;
mso-style-unhide:no;
mso-style-locked:yes;
mso-style-link:"Footnote Text";
mso-ansi-font-size:12.0pt;
mso-bidi-font-size:12.0pt;}
p.IBMTextStyle1, li.IBMTextStyle1, div.IBMTextStyle1
{mso-style-name:IBM_TextStyle1;
mso-style-priority:99;
mso-style-unhide:no;
mso-style-parent:"";
margin-top:.2in;
margin-right:0in;
margin-bottom:0in;
margin-left:0in;
margin-bottom:.0001pt;
mso-pagination:none;
mso-hyphenate:none;
font-size:10.0pt;
mso-bidi-font-size:12.0pt;
font-family:Arial;
mso-fareast-font-family:"Times New Roman";
mso-bidi-font-family:Tahoma;
mso-font-kerning:.5pt;
mso-fareast-language:HI;
mso-bidi-language:HI;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-size:11.0pt;
mso-ansi-font-size:11.0pt;
mso-bidi-font-size:11.0pt;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-hansi-font-family:Cambria;}
/* Page Definitions */
@page
{mso-footnote-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0clip_header.htm") fs;
mso-footnote-continuation-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0clip_header.htm") fcs;
mso-endnote-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0clip_header.htm") es;
mso-endnote-continuation-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0clip_header.htm") ecs;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1645620391;
mso-list-type:hybrid;
mso-list-template-ids:1762043640 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l0:level1
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:1.25in;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:1.75in;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:2.25in;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:2.75in;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:3.25in;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:3.75in;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:4.25in;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:4.75in;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:5.25in;
text-indent:-.25in;
font-family:Wingdings;}
@list l1
{mso-list-id:1706830360;
mso-list-type:hybrid;
mso-list-template-ids:-1828814432 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l1:level1
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:1.25in;
text-indent:-.25in;
font-family:Symbol;}
@list l1:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:1.75in;
text-indent:-.25in;
font-family:"Courier New";}
@list l1:level3
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:2.25in;
text-indent:-.25in;
font-family:Wingdings;}
@list l1:level4
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:2.75in;
text-indent:-.25in;
font-family:Symbol;}
@list l1:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:3.25in;
text-indent:-.25in;
font-family:"Courier New";}
@list l1:level6
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:3.75in;
text-indent:-.25in;
font-family:Wingdings;}
@list l1:level7
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:4.25in;
text-indent:-.25in;
font-family:Symbol;}
@list l1:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:4.75in;
text-indent:-.25in;
font-family:"Courier New";}
@list l1:level9
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:5.25in;
text-indent:-.25in;
font-family:Wingdings;}
@list l2
{mso-list-id:1763990293;
mso-list-type:hybrid;
mso-list-template-ids:496782592 67698705 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l2:level1
{mso-level-text:"%1\)";
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l2:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l2:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l2:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l2:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l2:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l2:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l2:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l2:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l3
{mso-list-id:1829401520;
mso-list-type:hybrid;
mso-list-template-ids:-1186195888 -65390646 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l3:level1
{mso-level-text:"%1\)";
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:.75in;
text-indent:-.25in;}
@list l3:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:1.25in;
text-indent:-.25in;}
@list l3:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
margin-left:1.75in;
text-indent:-9.0pt;}
@list l3:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:2.25in;
text-indent:-.25in;}
@list l3:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:2.75in;
text-indent:-.25in;}
@list l3:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
margin-left:3.25in;
text-indent:-9.0pt;}
@list l3:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:3.75in;
text-indent:-.25in;}
@list l3:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:4.25in;
text-indent:-.25in;}
@list l3:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
margin-left:4.75in;
text-indent:-9.0pt;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
-->
</style>
<br />
<div class="MsoNormal" style="color: #444444;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">I start off my Introduction to Netezza
(or Netezza 101) presentations with the question “Would you still use Google if
it took 7 days and 3 people o get your answer”, and most people scratch their
head at first wondering why I ask this. Let me explain.</span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">In my opinion, Google is a lot like
today’s analytic tools/applications. When you use Google, you give it some
search terms, and see what it comes up with. If you are lucky, the information
you want is on the first page, but maybe it is on page two or three. Or maybe
the search results are not what you were looking for, so you change the search
terms completely, or add/remove some terms and search again. Eventually you
find what you are looking for.</span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">Today’s train of thought analytics is
a lot like Google. You never know what someone is going to ask. You don't know
where the result of one query will lead, or what the results will ultimately
be. Unlike the report that gets the total sales for the past month, there is no
“map” to guide train of thought analytics. IBM Netezza provides the unique
ability to move beyond just reporting, and allows users to uncover the answers
they are looking for. </span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">IBM Netezza is the best solution for
train of thought analytics for a number of reasons:</span></div>
<ol>
<li style="color: #444444;"><span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;"><span style="font: 7pt "Times New Roman";"></span></span><span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">IBM Netezza does
NOT require indexes to perform optimally </span></li>
<li style="color: #444444;"><span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">IBM Netezza
allows analytics across all of your data, not just a subset (I talked about
this in an earlier post</span><a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftn1" name="_ftnref1" style="mso-footnote-id: ftn1;" title=""><span class="MsoFootnoteReference"><span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;"><span class="MsoFootnoteReference"><span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">[1]</span></span></span></span></a><span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">)</span></li>
</ol>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">In my opinion a database that relies
on indexes (or even worse, 19 different types of indexes) and aggregates to
perform well is ill suited for train of though analytics. Now, these databases
can run without indexes, as long as you take a very small sample of the data to
run against… But then you run into incorrect and/or poor results that will not
help drive more value, and may in fact hurt the bottom line. </span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">Let’s use an example to show why a
system that needs indexes is not suited for train of thought, or any ad-hoc,
analytics. Given the following tables:</span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">create table
car_sales(</span></div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;"> delivery_date date,</span></div>
<div class="MsoNormal" style="color: #444444; margin-left: 0.5in; text-indent: 0.5in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">make varchar(45),</span></div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;"> model varchar(45),</span></div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;"> model_year char(4),</span></div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;"> color varchar(20),</span></div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;"> VIN
varchar(45),</span></div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;"> selling_dealer varchar(45))</span></div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
<br /></div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">create table
dealer_sales(</span></div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;"> VIN
varchar(45),</span></div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;"> cost decimal (10,2)</span></div>
<div class="MsoNormal" style="color: #444444; margin-left: 0.5in; text-indent: 0.5in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">sales_price decimal(10,2),</span></div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;"> sales_person varchar(45))</span></div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
<br /></div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">create table
sales_people(</span></div>
<div class="MsoNormal" style="color: #444444; text-indent: 0.5in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;"> sales_person varchar(45),</span></div>
<div class="MsoNormal" style="color: #444444; margin-left: 0.5in; text-indent: 0.5in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">dealer varchar(45)</span></div>
<div class="MsoNormal" style="color: #444444; margin-left: 1in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">region
varchar(10))</span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">If you want the total of all sales
then you need only access the dealer_sales table. There are two things that
will make this query faster, a materialized view or an index that just contains
only the price column in the dealer_sales table. In this case the rows in table
dealer_sales are 102 bytes wide. If you created an index on the price column,
the index would be roughly 1/8<sup>th</sup> of the width of the table, so the
query should run roughly 8 times faster.
After seeing this query run a few times, a good DBA will create this
index, but it is too late for the people who already ran their analytic
queries. </span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">Now, what if the regional sales manager
wants to track the total sales by region at any given time. In order to
calculate this you need to join the dealer_sales and car_sales tables, and you
probably would want to create a join index (or an aggregate depending on which
database you are using) to allow that to be done efficiently. The only column
in these tables that is common across both tables is the VIN column, and that
is not one of the columns that you are even referencing in the query (price and
region, and probably date as well so he or she can look at the current day’s
sales, as well as the current week, month, year to date, etc.).</span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">If I were a regional manager I would
also want to do some optimization of the delivery of new cars to the dealers
where they are most likely to sell at the highest profit margin. Now, there are
a number of ways to do this, and each has an increasing potential to drive more
sales, if the current trends continue:</span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoListParagraphCxSpFirst" style="color: #444444; margin-left: 0.75in; text-indent: -0.25in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">1)<span style="font: 7pt "Times New Roman";"> </span></span><span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">Compute the average net profit (sales_price – cost) for
every region and ship more cars to that region than to other regions</span></div>
<div class="MsoListParagraphCxSpMiddle" style="color: #444444; margin-left: 1.25in; text-indent: -0.25in;">
<span style="font-family: Symbol; font-size: 9pt; letter-spacing: 0.1pt;">·<span style="font: 7pt "Times New Roman";"> </span></span><span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">This would require at least two join indexes, and likely
other secondary indexes on the sales_price and cost columns in dealer_sales.</span></div>
<div class="MsoListParagraphCxSpMiddle" style="color: #444444; margin-left: 0.75in; text-indent: -0.25in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">2)<span style="font: 7pt "Times New Roman";"> </span></span><span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">Compute the average net profit for each make (i.e. Ford,
Chevy, Dodge, Acura, etc.), and ship more of that make of car to the dealers
for that make in that region than to other regions</span></div>
<div class="MsoListParagraphCxSpMiddle" style="color: #444444; margin-left: 1.25in; text-indent: -0.25in;">
<span style="font-family: Symbol; font-size: 9pt; letter-spacing: 0.1pt;">·<span style="font: 7pt "Times New Roman";"> </span></span><span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">This would require the same indexes as above, but also an
index on the make column in the car_sales table.</span></div>
<div class="MsoListParagraphCxSpMiddle" style="color: #444444; margin-left: 0.75in; text-indent: -0.25in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">3)<span style="font: 7pt "Times New Roman";"> </span></span><span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">Compute the average net profit for each make and model, and
ship more of that model of car to the dealers for that make in that region than
to other regions</span></div>
<div class="MsoListParagraphCxSpMiddle" style="color: #444444; margin-left: 1.25in; text-indent: -0.25in;">
<span style="font-family: Symbol; font-size: 9pt; letter-spacing: 0.1pt;">·<span style="font: 7pt "Times New Roman";"> </span></span><span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">This would require the same indexes as above, but also an
index on the make and model columns in the car_sales table.</span></div>
<div class="MsoListParagraphCxSpMiddle" style="color: #444444; margin-left: 0.75in; text-indent: -0.25in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">4)<span style="font: 7pt "Times New Roman";"> </span></span><span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">But, maybe different regions also have a preference for
color, like in the north eastern US where white does not show the dirt from the
sand and salt on the roads in the winter. If we combine the color preference
with the make and model preference from above, then we can tailor the inventory
of each dealer to their customer set. </span></div>
<div class="MsoListParagraphCxSpMiddle" style="color: #444444; margin-left: 1.25in; text-indent: -0.25in;">
<span style="font-family: Symbol; font-size: 9pt; letter-spacing: 0.1pt;">·<span style="font: 7pt "Times New Roman";"> </span></span><span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">The color preference query would require the same indexes
as above, but also an index on the color column in the car_sales table.</span></div>
<div class="MsoListParagraphCxSpMiddle" style="color: #444444; margin-left: 0.75in; text-indent: -0.25in;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">5)<span style="font: 7pt "Times New Roman";"> </span></span><span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">Taking this even further, let’s look at inventory optimization.
What if we can eliminate the need to keep cars on the lot for months before
they sell. The historical sales might indicate that in Maine there is a three
week period at the beginning of May when their sales are three times their
normal rate for a two week period. Well, then I would want to make sure I have
enough cars on the lot there (optimized by make, model and color of course) to
meet this need, but I do not want to keep this much inventory all year long as
it ties up a lot of money. </span></div>
<div class="MsoListParagraphCxSpLast" style="color: #444444; margin-left: 1.25in; text-indent: -0.25in;">
<span style="font-family: Symbol; font-size: 9pt; letter-spacing: 0.1pt;">·<span style="font: 7pt "Times New Roman";"> </span></span><span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">This would require more tuning of the data model with an
index on the delivery_date column in the car_sales table.</span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">Now, you can say that after all of
this, you have all of the indexes and/or aggregates you might ever need. But that
is only true for these queries. What about the local dealership manager who
wants to see which salesman has sold the most cars in the past month, or sold
the car with the highest average profit margin.</span></div>
<div class="MsoNormal" style="color: #444444;">
<br /></div>
<div class="MsoNormal" style="color: #444444;">
<span style="font-family: Arial; font-size: 9pt; letter-spacing: 0.1pt;">This is train of thought analytics,
where one answer drives the next question. It is like going for a drive with no
destination in mind. You cannot use MapQuest or Google Maps, since you do not
know where you are going. </span></div>
<div class="IBMTextStyle1" style="color: #444444;">
<span style="font-size: 9pt;">The revolutionary design
of the IBM Netezza data warehouse provides exceptional performance without the
need for indexes. The IBM Netezza architecture is based on a fundamental
computer science principle: when operating on large data sets, do not move data
unless absolutely necessary. IBM Netezza data warehouse appliances fully
exploit this principle by utilizing commodity components called field
programmable gate arrays (FPGAs) to filter out extraneous data as early in the
data stream as possible, and as fast as data streams off the disk. This process
of data elimination close to the data source removes I/O bottlenecks and frees
up downstream components (CPU, memory and network) from processing superfluous
data, and is therefore expected to have a significant multiplier effect on
system performance.</span></div>
<div style="mso-element: footnote-list;">
<br />
<hr align="left" size="1" width="33%" />
<div id="ftn1" style="mso-element: footnote;">
<div class="MsoFootnoteText">
<a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftnref1" name="_ftn1" style="mso-footnote-id: ftn1;" title=""><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 9pt;"><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 9pt;">[1]</span></span></span></span></a><span style="font-size: 9pt;"> <span style="color: #444444;">http://dsnowondb2.blogspot.com/2012/05/importance-of-agility-for-analytic.html</span></span></div>
</div>
</div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com0tag:blogger.com,1999:blog-15757447.post-33578071389783818622012-05-02T11:10:00.000-04:002012-05-02T11:10:07.999-04:00IBM Analytics help SUNY MS Research Team Improve Patient Care<a href="http://thinking.netezza.com/press_release/leading-global-multiple-sclerosis-research-center-taps-ibm-analytics-improve-patient" target="_blank">http://thinking.netezza.com/press_release/leading-global-multiple-sclerosis-research-center-taps-ibm-analytics-improve-patient</a><br />Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com0tag:blogger.com,1999:blog-15757447.post-46204448744148120552012-05-02T09:49:00.000-04:002012-05-02T11:10:49.252-04:00IBM Netezza Delivers the Best TCO for Analytics Applications<style>
<!--
/* Font Definitions */
@font-face
{font-family:Arial;
panose-1:2 11 6 4 2 2 2 2 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:"Courier New";
panose-1:2 7 3 9 2 2 5 2 4 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;
mso-font-charset:2;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:0 268435456 0 0 -2147483648 0;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:"MS ??";
panose-1:0 0 0 0 0 0 0 0 0 0;
mso-font-charset:128;
mso-generic-font-family:auto;
mso-font-format:other;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoFootnoteText, li.MsoFootnoteText, div.MsoFootnoteText
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-link:"Footnote Text Char";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
span.MsoFootnoteReference
{mso-style-priority:99;
mso-style-unhide:no;
font-family:"Times New Roman";
mso-bidi-font-family:"Times New Roman";
vertical-align:super;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-qformat:yes;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoListParagraphCxSpFirst, li.MsoListParagraphCxSpFirst, div.MsoListParagraphCxSpFirst
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoListParagraphCxSpMiddle, li.MsoListParagraphCxSpMiddle, div.MsoListParagraphCxSpMiddle
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoListParagraphCxSpLast, li.MsoListParagraphCxSpLast, div.MsoListParagraphCxSpLast
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
span.FootnoteTextChar
{mso-style-name:"Footnote Text Char";
mso-style-priority:99;
mso-style-unhide:no;
mso-style-locked:yes;
mso-style-link:"Footnote Text";
mso-ansi-font-size:12.0pt;
mso-bidi-font-size:12.0pt;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-size:11.0pt;
mso-ansi-font-size:11.0pt;
mso-bidi-font-size:11.0pt;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-hansi-font-family:Cambria;}
/* Page Definitions */
@page
{mso-footnote-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0:clip_header.htm") fs;
mso-footnote-continuation-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0:clip_header.htm") fcs;
mso-endnote-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0:clip_header.htm") es;
mso-endnote-continuation-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0:clip_header.htm") ecs;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:836841935;
mso-list-type:hybrid;
mso-list-template-ids:246479970 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l0:level1
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
-->
</style>
<br />
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">More that 150 customers have compared
IBM Netezza to Teradata, as well as other competitors, and they chose Netezza
for a number of reasons. But the one underlying factor that most of these
customers have told us, is how fast the IBM Netezza system paid for itself.
This payback or return on investment (ROI) can come form many sources,
including:</span></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div class="MsoListParagraphCxSpFirst" style="mso-layout-grid-align: none; mso-list: l0 level1 lfo1; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Symbol; font-size: 8pt; letter-spacing: 0.1pt;">·<span style="font: 7pt "Times New Roman";">
</span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">A low up front
cost</span></div>
<div class="MsoListParagraphCxSpMiddle" style="mso-layout-grid-align: none; mso-list: l0 level1 lfo1; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Symbol; font-size: 8pt; letter-spacing: 0.1pt;">·<span style="font: 7pt "Times New Roman";">
</span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">Drastically
reduced administration on the IBM Netezza system</span></div>
<div class="MsoListParagraphCxSpMiddle" style="mso-layout-grid-align: none; mso-list: l0 level1 lfo1; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Symbol; font-size: 8pt; letter-spacing: 0.1pt;">·<span style="font: 7pt "Times New Roman";">
</span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">The ability to
run analytics on all of your data (not a sample)</span></div>
<div class="MsoListParagraphCxSpLast" style="mso-layout-grid-align: none; mso-list: l0 level1 lfo1; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Symbol; font-size: 8pt; letter-spacing: 0.1pt;">·<span style="font: 7pt "Times New Roman";">
</span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">The ability to
run queries/reports that never finished on your existing system</span></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">While many people focus on the upfront
cost of an item, in my opinion it is far more important to examine the total
cost of ownership for that item. Think of it in the context of buying a new
car. If Car-T costs $22,000 and Car-N costs $26,000 then that is a difference
of $4,000. But, there is more to the costs of owning a car than just the
purchase price. You also have insurance (think of that like upgrade protection/yearly
maintenance when comparing it to a data warehouse system), and maintenance (the
cost of the DBAs to keep the system running), as well as the cost of gas (the
cost of electricity, cooling, etc.). If, for example, Car-T gets 12 mile per
gallon (mpg) and Car-N gets 28 mpg, and you usually drive 15,000 mile per year.
Then at a cost of $3.95 per gallon, it would cost you $4937 per year for gas
for Car-T and only $2116 per year for Car-N. So, in this case Car-N would pay
for the price difference in under 2 years, and every year after that you would
reap the benefits of that choice. </span></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">Now, let’s make this car example match
more closely to what data warehouse customers have to consider. In this case
Car-T would be a 2-seater, cost $25,000 to buy, get 10 mpg, require premium
gas, and have a top speed of 85 miles per hour (mph). Car-N would cost $15,000,
have room for a family of 5, get 30 mpg using regular gas, and have a top speed
of 300 mph.</span></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">If you can get the answers you want 3
times or more faster, at about half the up front cost and at one third of the
ongoing costs, why would you choose anything else? Customers like MediaMath
examined technologies form a number of different vendors, and chose Netezza
because “</span><span style="color: black; font-family: Arial; font-size: 8pt;">Netezza’s appliance approach would be less costly than other
options.”<a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftn1" name="_ftnref1" style="mso-footnote-id: ftn1;" title=""><span class="MsoFootnoteReference"><span style="font-family: Arial;"><span class="MsoFootnoteReference"><span style="color: black; font-family: Arial; font-size: 8pt;">[1]</span></span></span></span></a></span><span style="color: black; font-family: Verdana; font-size: 8.5pt;"> </span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">And analysts (the consumer reports of
the IT industry) agree. In their report, </span><span style="color: black; font-family: Arial; font-size: 8pt;">The Total Economic
Impact Of IBM’s Netezza Data Warehouse Appliance With Advanced Analytics</span><a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftn2" name="_ftnref2" style="mso-footnote-id: ftn2;" title=""><span class="MsoFootnoteReference"><span style="color: black; font-family: Arial; font-size: 8pt;"><span class="MsoFootnoteReference"><span style="color: black; font-family: Arial; font-size: 8pt;">[2]</span></span></span></span></a><span style="color: black; font-family: Arial; font-size: 8pt;">,
</span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">Forrester examined a Netezza
customer’s use of the IBM Netezza appliance, and based on their calculations
the system paid for itself in under a year. </span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;"></span></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">With the cost of DBAs (and gas)
escalating, don't keep feeding your gas guzzler, take a test drive of a new IBM
Netezza appliance and see how fast it really is, and how quickly it will pay
for itself.</span></div>
<div style="mso-element: footnote-list;">
<br />
<hr align="left" size="1" width="33%" />
<div id="ftn1" style="mso-element: footnote;">
<div class="MsoFootnoteText">
<a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftnref1" name="_ftn1" style="mso-footnote-id: ftn1;" title=""><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8pt;"><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8pt;">[1]</span></span></span></span></a><span style="font-size: 8pt;"> <span style="color: blue;">http://www.google.com/url?sa=t&rct=j&q=nucleus%20research%20mediamath&source=web&cd=1&ved=0CDEQFjAA&url=http%3A%2F%2Fthinking.netezza.com%2Fsites%2Fdefault%2Ffiles%2Fdocument%2FNucleus_Research_ROI.pdf&ei=USyET4DgLIbV0QGO8sTnBw&usg=AFQjCNGqcbnE5tJxTsiwMB71uTMc5rCXOw&cad=rja</span></span></div>
</div>
<div id="ftn2" style="mso-element: footnote;">
<div class="MsoFootnoteText">
<a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftnref2" name="_ftn2" style="mso-footnote-id: ftn2;" title=""><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8pt;"><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8pt;">[2]</span></span></span></span></a><span style="color: blue; font-size: 8pt;"> http://thinking.netezza.com/pdf/total-economic-impact-ibms-netezza-data-warehouse-appliance-advanced-analytics-forrester-total</span></div>
</div>
</div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com5tag:blogger.com,1999:blog-15757447.post-82827736597734709942012-05-01T07:55:00.001-04:002012-05-01T10:04:13.397-04:00The Importance of Agility for Analytic Applications<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">In the context of data warehousing,
agility means that the system can quickly and easily adapt to and accommodate;
changes in data volumes, new data sources, new subject areas, new applications
and/or new users. In order for a data warehouse to be able to do this, it needs
to be able to run any query against any data model/schema. It must also be able
to process all of the data, no mater what the query or what table(s) are being
accessed, and do so quickly – without impacting the other users of the system.</span><br />
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Arial;
panose-1:2 11 6 4 2 2 2 2 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:"Courier New";
panose-1:2 7 3 9 2 2 5 2 4 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;
mso-font-charset:2;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:0 268435456 0 0 -2147483648 0;}
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;
mso-font-charset:2;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:0 268435456 0 0 -2147483648 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:"MS ??";
panose-1:0 0 0 0 0 0 0 0 0 0;
mso-font-charset:128;
mso-generic-font-family:auto;
mso-font-format:other;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoFootnoteText, li.MsoFootnoteText, div.MsoFootnoteText
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-link:"Footnote Text Char";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
span.MsoFootnoteReference
{mso-style-priority:99;
mso-style-unhide:no;
font-family:"Times New Roman";
mso-bidi-font-family:"Times New Roman";
vertical-align:super;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-qformat:yes;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoListParagraphCxSpFirst, li.MsoListParagraphCxSpFirst, div.MsoListParagraphCxSpFirst
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoListParagraphCxSpMiddle, li.MsoListParagraphCxSpMiddle, div.MsoListParagraphCxSpMiddle
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoListParagraphCxSpLast, li.MsoListParagraphCxSpLast, div.MsoListParagraphCxSpLast
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
span.FootnoteTextChar
{mso-style-name:"Footnote Text Char";
mso-style-priority:99;
mso-style-unhide:no;
mso-style-locked:yes;
mso-style-link:"Footnote Text";
mso-ansi-font-size:12.0pt;
mso-bidi-font-size:12.0pt;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-size:11.0pt;
mso-ansi-font-size:11.0pt;
mso-bidi-font-size:11.0pt;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-hansi-font-family:Cambria;}
/* Page Definitions */
@page
{mso-footnote-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0clip_header.htm") fs;
mso-footnote-continuation-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0clip_header.htm") fcs;
mso-endnote-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0clip_header.htm") es;
mso-endnote-continuation-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0clip_header.htm") ecs;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:646130616;
mso-list-type:hybrid;
mso-list-template-ids:-1102008050 67698703 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l0:level1
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l1
{mso-list-id:774055069;
mso-list-type:hybrid;
mso-list-template-ids:-1737449796 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l1:level1
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:.25in;
text-indent:-.25in;
font-family:Symbol;}
@list l1:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:.75in;
text-indent:-.25in;
font-family:"Courier New";}
@list l1:level3
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:1.25in;
text-indent:-.25in;
font-family:Wingdings;}
@list l1:level4
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:1.75in;
text-indent:-.25in;
font-family:Symbol;}
@list l1:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:2.25in;
text-indent:-.25in;
font-family:"Courier New";}
@list l1:level6
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:2.75in;
text-indent:-.25in;
font-family:Wingdings;}
@list l1:level7
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:3.25in;
text-indent:-.25in;
font-family:Symbol;}
@list l1:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:3.75in;
text-indent:-.25in;
font-family:"Courier New";}
@list l1:level9
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:4.25in;
text-indent:-.25in;
font-family:Wingdings;}
@list l2
{mso-list-id:1323660874;
mso-list-type:hybrid;
mso-list-template-ids:-2115193956 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l2:level1
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:.25in;
text-indent:-.25in;
font-family:Symbol;}
@list l2:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:.75in;
text-indent:-.25in;
font-family:"Courier New";}
@list l2:level3
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:1.25in;
text-indent:-.25in;
font-family:Wingdings;}
@list l2:level4
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:1.75in;
text-indent:-.25in;
font-family:Symbol;}
@list l2:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:2.25in;
text-indent:-.25in;
font-family:"Courier New";}
@list l2:level6
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:2.75in;
text-indent:-.25in;
font-family:Wingdings;}
@list l2:level7
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:3.25in;
text-indent:-.25in;
font-family:Symbol;}
@list l2:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:3.75in;
text-indent:-.25in;
font-family:"Courier New";}
@list l2:level9
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:4.25in;
text-indent:-.25in;
font-family:Wingdings;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
-->
</style><br />
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">You can accomplish this is a number of
ways, including:</span></div>
<div class="MsoListParagraphCxSpFirst" style="margin-left: .25in; mso-add-space: auto; mso-layout-grid-align: none; mso-list: l2 level1 lfo1; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Symbol; font-size: 8pt; letter-spacing: 0.1pt;">·<span style="font: 7pt "Times New Roman";"> </span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">Over-building the original data warehouse to be able to
handle some incremental growth</span></div>
<div class="MsoListParagraphCxSpMiddle" style="margin-left: .25in; mso-add-space: auto; mso-layout-grid-align: none; mso-list: l2 level1 lfo1; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Symbol; font-size: 8pt; letter-spacing: 0.1pt;">·<span style="font: 7pt "Times New Roman";"> </span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">Restricting access to data or data sampling</span></div>
<div class="MsoListParagraphCxSpLast" style="margin-left: .25in; mso-add-space: auto; mso-layout-grid-align: none; mso-list: l2 level1 lfo1; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Symbol; font-size: 8pt; letter-spacing: 0.1pt;">·<span style="font: 7pt "Times New Roman";"> </span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">Adding more resources for the new users, data and
applications as they come on board. </span></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">But normally there are a number of
issues with these approaches,</span></div>
<div class="MsoListParagraphCxSpFirst" style="margin-left: .25in; mso-add-space: auto; mso-layout-grid-align: none; mso-list: l1 level1 lfo2; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Symbol; font-size: 8pt; letter-spacing: 0.1pt;">·<span style="font: 7pt "Times New Roman";"> </span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">Clients do not want to spend 2-3 times as much as they
need to up front so they can accommodate some future growth that may or may not
occur</span></div>
<div class="MsoListParagraphCxSpMiddle" style="margin-left: .25in; mso-add-space: auto; mso-layout-grid-align: none; mso-list: l1 level1 lfo2; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Symbol; font-size: 8pt; letter-spacing: 0.1pt;">·<span style="font: 7pt "Times New Roman";"> </span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">Data sampling means that there is a good chance that the
important data may be missed</span></div>
<div class="MsoListParagraphCxSpLast" style="margin-left: .25in; mso-add-space: auto; mso-layout-grid-align: none; mso-list: l1 level1 lfo2; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Symbol; font-size: 8pt; letter-spacing: 0.1pt;">·<span style="font: 7pt "Times New Roman";"> </span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">Adding more resources to an exiting Teradata system can be
a long, arduous, and costly process</span><a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftn1" name="_ftnref1" style="mso-footnote-id: ftn1;" title=""><span class="MsoFootnoteReference"><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;"><span class="MsoFootnoteReference"><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">[1]</span></span></span></span></a><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;"></span></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">In our opinion, it is far more
effective, from a cost and effort, as well as overall performance of the system
perspective, to augment the Teradata system with IBM Netezza data warehouse
appliances where you can run the new applications without impacting the current
users at all. Rather than wait for weeks for the new system to arrive, the data
model to be tweaked for the new application, the data to be moved, and the
database to be tuned, why not roll in an IBM Netezza appliance, copy the data
model (schema) as is, load the data, and be up and running in hours? </span><br />
<br />
<span style="color: black; font-family: Arial; font-size: 8pt;">As my colleague Nancy Kopp-Hensley discussed in her article "<a href="http://smarterquestions.org/2011/05/ibm-consolidate-smarter-with-the-data-warehouse-ecosystem/" target="_blank">Consolidate Smarter with the Data Warehouse Ecosystem</a>", we had a client that became challenged with query performance with their applications, and yet they were anxious to roll out some new applications in their sales and marketing divisions. Over time, they became challenged with
query performance on their applications, and yet they were anxious to roll out
some new applications in sales and marketing. And to top it off the business needed
these new applications on-line right away. Rather than frustrate the business
with a long timeline, which would have included first tuning the EDW to fix the
existing problems before even starting the expansion, they chose to offload the
new applications to a Netezza appliance. The result? Queries ran 24 times
faster and they were able to achieve a much lower total cost of ownership (TCO). </span></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">You could also move your deep analytic
applications to the IBM Netezza platform, and run against the entire data set,
not just the last week’s data, or a sample of the data from the last year like
in the EDW. This will provide more accurate results and predictions that will help
drive more value to the organization. Consider an example, you are trying to
predict what a shopper can be influenced to buy, given a coupon. Let’s say that
the shopper has bought the following items in the past month:</span></div>
<div class="MsoNormal">
<br /></div>
<div class="MsoListParagraphCxSpFirst" style="mso-layout-grid-align: none; mso-list: l0 level1 lfo3; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">1.<span style="font: 7pt "Times New Roman";">
</span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">Topographical Map
of Alaska</span></div>
<div class="MsoListParagraphCxSpMiddle" style="mso-layout-grid-align: none; mso-list: l0 level1 lfo3; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">2.<span style="font: 7pt "Times New Roman";">
</span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">The book “Hiking
Alaska”</span></div>
<div class="MsoListParagraphCxSpMiddle" style="mso-layout-grid-align: none; mso-list: l0 level1 lfo3; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">3.<span style="font: 7pt "Times New Roman";">
</span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">Tent</span></div>
<div class="MsoListParagraphCxSpMiddle" style="mso-layout-grid-align: none; mso-list: l0 level1 lfo3; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">4.<span style="font: 7pt "Times New Roman";">
</span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">Back pack</span></div>
<div class="MsoListParagraphCxSpMiddle" style="mso-layout-grid-align: none; mso-list: l0 level1 lfo3; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">5.<span style="font: 7pt "Times New Roman";">
</span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">Sleeping bag</span></div>
<div class="MsoListParagraphCxSpMiddle" style="mso-layout-grid-align: none; mso-list: l0 level1 lfo3; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">6.<span style="font: 7pt "Times New Roman";">
</span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">Compass</span></div>
<div class="MsoListParagraphCxSpLast" style="mso-layout-grid-align: none; mso-list: l0 level1 lfo3; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">7.<span style="font: 7pt "Times New Roman";">
</span></span><span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">Portable GPS</span></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">In their current shopping expedition
they are buying a pair of hiking boots. Looking at the list of what they are
buying, we might hazard a guess that they are looking to start hiking, but we
do not know where, or know what else they might need. So, let’s sample their
historical purchases, and see what we can come up with. Even with a 20% sample
(which is much larger than normal) we might retrieve the tent and compass. We
still do not know where they are going, so we might offer them a coupon for a
sleeping bag. But we see that they already have one. </span></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div class="MsoNormal" style="mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: #3f403f; font-family: Arial; font-size: 8pt; letter-spacing: 0.1pt;">If the sample had included the book
and the backpack instead, we now have an idea they might be going to Alaska, so
maybe we should offer them a portable GPS for 20% off. This could be bad in a
couple of ways… If the offer is for the same GPS they bought, they are likely
to return the one they have and re-buy it, which just cut into the profit. If
the offer is for a newer, better GPS and a price close to the price of what
they just paid, then they may return the old one, or if they bought it just
outside of the 30 day return window, you are likely to have an unhappy customer
on your hands. This example shows why it is important to have fast analytics on
all of your data, not just a “representative sample”, and this is what you can
get by augmenting your EDW with an IBM Netezza data warehouse appliance.</span></div>
<div class="MsoNormal" style="line-height: 141%; margin-right: 8.15pt; mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div style="mso-element: footnote-list;">
<hr align="left" size="1" width="33%" />
<div id="ftn1" style="mso-element: footnote;">
<div class="MsoFootnoteText">
<a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftnref1" name="_ftn1" style="mso-footnote-id: ftn1;" title=""><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8pt;"><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8pt;">[1]</span></span></span></span></a><span style="font-size: 8pt;"> </span><span style="color: #141413; font-family: Helvetica; font-size: 8pt;">Teradata Customer Story -
Overstock.com retrieved 05/17/2011 from </span><span style="color: #36619e; font-family: Helvetica; font-size: 8pt;">http://tinyurl.com/6mdktgm
</span><span style="color: #141413; font-family: Helvetica; font-size: 8pt;">-Since removed from the site</span><span style="font-size: 8pt;"></span></div>
</div>
<div id="ftn2" style="mso-element: footnote;">
<div class="MsoFootnoteText">
<a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftnref2" name="_ftn2" style="mso-footnote-id: ftn2;" title=""><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8pt;"><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 8pt;"></span></span></span></span></a></div>
</div>
</div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com1tag:blogger.com,1999:blog-15757447.post-26960698858030954362012-04-30T19:07:00.000-04:002012-05-01T17:38:46.311-04:00<span style="color: black; font-size: 10pt; letter-spacing: -0.1pt; line-height: 104%;">A number of Teradata customers have moved some or all of their data and
analytic applications to IBM Netezza data warehouse appliances. </span><span style="color: black; font-size: 10pt; letter-spacing: -0.25pt; line-height: 104%;">The reasons these customers give for their move
invariably include:</span><br />
<style>
<!--
/* Font Definitions */
@font-face
{font-family:Arial;
panose-1:2 11 6 4 2 2 2 2 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:"Courier New";
panose-1:2 7 3 9 2 2 5 2 4 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:Geneva;
panose-1:2 11 5 3 3 4 4 4 2 4;
mso-font-charset:77;
mso-generic-font-family:swiss;
mso-font-format:other;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;
mso-font-charset:2;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:0 268435456 0 0 -2147483648 0;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;
mso-font-charset:77;
mso-generic-font-family:roman;
mso-font-format:other;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:Verdana;
panose-1:2 11 6 4 3 5 4 4 2 4;
mso-font-charset:77;
mso-generic-font-family:roman;
mso-font-format:other;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:Cambria;
panose-1:2 4 5 3 5 4 6 3 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:3 0 0 0 1 0;}
@font-face
{font-family:"MS ??";
panose-1:0 0 0 0 0 0 0 0 0 0;
mso-font-charset:128;
mso-generic-font-family:auto;
mso-font-format:other;
mso-font-pitch:variable;
mso-font-signature:1 134676480 16 0 131072 0;}
@font-face
{font-family:"Lucida Grande";
panose-1:2 11 6 0 4 5 2 2 2 4;
mso-font-charset:0;
mso-generic-font-family:auto;
mso-font-pitch:variable;
mso-font-signature:-520090897 1342218751 0 0 447 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-parent:"";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoFootnoteText, li.MsoFootnoteText, div.MsoFootnoteText
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-link:"Footnote Text Char";
margin:0in;
margin-bottom:.0001pt;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
span.MsoFootnoteReference
{mso-style-priority:99;
mso-style-unhide:no;
font-family:"Times New Roman";
mso-bidi-font-family:"Times New Roman";
vertical-align:super;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
mso-style-unhide:no;
font-family:"Times New Roman";
mso-bidi-font-family:"Times New Roman";
color:blue;
text-decoration:underline;
text-underline:single;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-noshow:yes;
mso-style-priority:99;
color:purple;
mso-themecolor:followedhyperlink;
text-decoration:underline;
text-underline:single;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-qformat:yes;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoListParagraphCxSpFirst, li.MsoListParagraphCxSpFirst, div.MsoListParagraphCxSpFirst
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoListParagraphCxSpMiddle, li.MsoListParagraphCxSpMiddle, div.MsoListParagraphCxSpMiddle
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
p.MsoListParagraphCxSpLast, li.MsoListParagraphCxSpLast, div.MsoListParagraphCxSpLast
{mso-style-priority:99;
mso-style-unhide:no;
mso-style-qformat:yes;
mso-style-type:export-only;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
mso-add-space:auto;
mso-pagination:widow-orphan;
font-size:12.0pt;
font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-bidi-font-family:"Times New Roman";}
span.FootnoteTextChar
{mso-style-name:"Footnote Text Char";
mso-style-priority:99;
mso-style-unhide:no;
mso-style-locked:yes;
mso-style-link:"Footnote Text";
mso-ansi-font-size:12.0pt;
mso-bidi-font-size:12.0pt;}
.MsoChpDefault
{mso-style-type:export-only;
mso-default-props:yes;
font-size:11.0pt;
mso-ansi-font-size:11.0pt;
mso-bidi-font-size:11.0pt;
font-family:Cambria;
mso-ascii-font-family:Cambria;
mso-fareast-font-family:"MS ??";
mso-hansi-font-family:Cambria;}
/* Page Definitions */
@page
{mso-footnote-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0clip_header.htm") fs;
mso-footnote-continuation-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0clip_header.htm") fcs;
mso-endnote-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0clip_header.htm") es;
mso-endnote-continuation-separator:url("Macintosh HD:Users:dsnow:Library:Caches:TemporaryItems:msoclip:0clip_header.htm") ecs;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.25in 1.0in 1.25in;
mso-header-margin:.5in;
mso-footer-margin:.5in;
mso-paper-source:0;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1536117237;
mso-list-type:hybrid;
mso-list-template-ids:-402753320 67698689 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l0:level1
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
-->
</style><br />
<div class="MsoListParagraphCxSpFirst" style="line-height: 104%; margin-right: 6.6pt; mso-add-space: auto; mso-layout-grid-align: none; mso-list: l0 level1 lfo1; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: black; font-family: Symbol; font-size: 10pt; line-height: 104%;">·<span style="font: 7pt "Times New Roman";"> </span></span><span style="color: black; font-size: 10pt; line-height: 104%;">Time
to value</span></div>
<div class="MsoListParagraphCxSpMiddle" style="line-height: 104%; margin-right: 6.6pt; mso-add-space: auto; mso-layout-grid-align: none; mso-list: l0 level1 lfo1; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: black; font-family: Symbol; font-size: 10pt; line-height: 104%;">·<span style="font: 7pt "Times New Roman";"> </span></span><span style="color: black; font-size: 10pt; line-height: 104%;">Agility
and the ability to grow with new workloads</span></div>
<div class="MsoListParagraphCxSpMiddle" style="line-height: 104%; margin-right: 6.6pt; mso-add-space: auto; mso-layout-grid-align: none; mso-list: l0 level1 lfo1; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: black; font-family: Symbol; font-size: 10pt; line-height: 104%;">·<span style="font: 7pt "Times New Roman";"> </span></span><span style="color: black; font-size: 10pt; line-height: 104%;">Reducing
their cost of ongoing maintenance</span></div>
<div class="MsoListParagraphCxSpLast" style="line-height: 104%; margin-right: 6.6pt; mso-add-space: auto; mso-layout-grid-align: none; mso-list: l0 level1 lfo1; mso-pagination: none; text-autospace: none; text-indent: -.25in;">
<span style="color: black; font-family: Symbol; font-size: 10pt; line-height: 104%;">·<span style="font: 7pt "Times New Roman";"> </span></span><span style="color: black; font-size: 10pt; line-height: 104%;">Improving
query performance – particularly for complex analytics and ad-hoc environments
as data volumes grow.</span></div>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt; mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt; mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: black; font-size: 10pt; line-height: 104%;">Over my next
few posts I will dig deeper into these reasons and show the value of the IBM
Netezza appliance.</span></div>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt; mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt; mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: black; font-size: 10pt; line-height: 104%;">One of
Teradata’s reference customers, Overstock.com, was growing rapidly, and their
warehouse was growing at over 60% per year. Because they are an e-commerce company, they
wanted to monitor and measure the effectiveness of their email campaigns. In
order to keep up with these analytic requirements they needed to build a new
analytic system to satisfy their current and future needs. In Overstock.com’s
own words, “time-to-market”, or time to value, was of upmost importance.
Overstock.com chose Teradata because they promised a 5-6 month delivery using a
phased implementation project.</span><a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftn1" name="_ftnref1" style="mso-footnote-id: ftn1;" title=""><span class="MsoFootnoteReference"><span style="color: black; font-family: Cambria; letter-spacing: 0.05pt;"><span class="MsoFootnoteReference"><span style="color: black; font-family: Cambria; font-size: 12pt; letter-spacing: 0.05pt;">[1]</span></span></span></span></a><span style="color: black; font-size: 10pt; line-height: 104%;">
</span></div>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt; mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt; mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: black; font-size: 10pt; line-height: 104%;">In my opinion,
Teradata took way too long to deliver a production ready system to
Overstock.com. In fact many Netezza customers openly talk about how fast they
have been up and running production workloads on their Netezza systems. <span style="letter-spacing: 0.05pt;">Con-way Freight is a great example. IBM </span></span><span style="color: black; font-size: 10pt; line-height: 104%;">Netezza's initial set-up took less than 48 hours, and within the
next two days, their entire data set was loaded onto the Netezza appliance and
users had full access to the system. Four days after signing the purchase order
with a Proof of Concept system in place, the new BI project was made available
to internal users at Con-way Freight. And three weeks from the purchase date,
the IBM Netezza-powered platform was running in full-scale production.<a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftn2" name="_ftnref2" style="mso-footnote-id: ftn2;" title=""><span class="MsoFootnoteReference"><span style="font-family: Cambria;"><span class="MsoFootnoteReference"><span style="color: black; font-family: Cambria; font-size: 10pt;">[2]</span></span></span></span></a>
<b style="mso-bidi-font-weight: normal;"> </b></span></div>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt;">
<br /></div>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt;">
<span style="color: black; font-size: 10pt; line-height: 104%;"><b>Now, in my opinion, that is time to
value. </b></span></div>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt; mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt; mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: black; font-size: 10pt; line-height: 104%;">Some of you
might be asking, “how can Netezza do this?” Well, it all comes down to the
simplicity of the Netezza system. Rather than spending days or weeks trying to
decide between 19 different types of indexes like in Teradata, Netezza
customers simple create the table and load it – that’s it. Netezza does not
need join indexes, primary indexes, or partitioned primary indexes to perform
well the way Teradata does.</span><span class="MsoFootnoteReference"><span style="color: black; font-family: Cambria;"> <a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftn3" name="_ftnref3" style="mso-footnote-id: ftn3;" title=""><span class="MsoFootnoteReference"><span style="color: black; font-family: Cambria; font-size: 12pt;">[3]</span></span></a></span></span><span style="color: black; font-size: 10pt; line-height: 104%;"></span></div>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt; mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt; mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: black; font-size: 10pt; line-height: 104%;">And with
Netezza, you will not have to worry about growth and performance. The Netezza
appliance scales linearly as you add data and additional racks to your system,
without the need for adding more DBA resources, or doing more tuning of the
database. In fact Christine Tilford from T-Mobile talks about growing from
100TB to 500TB to 1PB to 2PB, all with the same team (with only one
DBA/engineer) in </span><a href="http://www.youtube.com/watch?v=5VbxoD5pGqE"><span style="font-size: 10pt; line-height: 104%;">this
video</span></a><span style="color: black; font-size: 10pt; line-height: 104%;">. This video also talks about true time to value, where
Christine explains how T-Mobile was able to help the US Coast Guard locate a
family whose boat had capsized using the power of the Netezza appliance. </span></div>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt; mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<br /></div>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt; mso-layout-grid-align: none; mso-pagination: none; text-autospace: none;">
<span style="color: black; font-size: 10pt; line-height: 104%;">If you want
the fastest time to value, choose the proven leader, IBM’s Netezza 1000
appliance.</span></div>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt;">
<br /></div>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt;">
<br /></div>
For More Information:<br />
<ul>
<li>
<b><u><a href="http://www.netezza.com/noderage/"><span style="text-decoration: underline;"><span style="font-weight: bold;">White Paper: Break the "Add More Nodes" Cycle</span></span></a></u></b></li>
<li>
<b><u><a href="http://thinking.netezza.com/node-rage">Video: Node Rage Support Group for Teradata Users: Session 1</a></u></b></li>
</ul>
<div class="MsoNormal" style="line-height: 104%; margin-right: 6.6pt;">
<br /></div>
<div style="mso-element: footnote-list;">
<hr align="left" size="1" width="33%" />
<div id="ftn1" style="mso-element: footnote;">
<div class="MsoFootnoteText">
<a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftnref1" name="_ftn1" style="mso-footnote-id: ftn1;" title=""><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 7pt;"><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 7pt;">[1]</span></span></span></span></a><span style="font-size: 7pt;"><span style="color: red;"> Teradata Customer Story - Overstock.com retrieved
05/17/2011 from</span> </span><span style="color: black; font-size: 7pt;">http://tinyurl.com/6mdktgm: Since removed from the site</span></div>
</div>
<div id="ftn2" style="mso-element: footnote;">
<div class="MsoFootnoteText">
<a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftnref2" name="_ftn2" style="mso-footnote-id: ftn2;" title=""><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 7pt;"><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 7pt;">[2]</span></span></span></span></a><span style="font-size: 7pt;"> <span style="color: red;">Con-way Freight Case Study, </span></span><span style="font-size: 7pt;"><span style="color: red;">retrieved from</span> </span><span style="color: black; font-size: 7pt;">http://www.google.com/url?sa=t&rct=j&q=con-way
netezza&source=web&cd=5&ved=0CD4QFjAE&url=http%3A%2F%2Fwww.netezza.com%2Fdocuments%2Fcon-way-freight-case-study.pdf&ei=Xwy4ToTMDaOo2wWKjL3MDQ&usg=AFQjCNEgDL1PIvwHanu8uGh1Um8NTD6O4Q&cad=rja
– Jan 31, 2012</span></div>
</div>
<div id="ftn3" style="mso-element: footnote;">
<div class="MsoFootnoteText">
<a href="http://www.blogger.com/blogger.g?blogID=15757447#_ftnref3" name="_ftn3" style="mso-footnote-id: ftn3;" title=""><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 7pt;"><span class="MsoFootnoteReference"><span style="font-family: Cambria; font-size: 7pt;">[3]</span></span></span></span></a><span style="font-size: 7pt;"> <span style="color: red;">Session 2062, Partners, The Teradata User Group
October 24-28, 2010 San Diego - Engineering Techniques to Achieve a Performant
PDM</span></span><span style="color: #0f0f0f; font-size: 7pt;">
– By Mark Miller and Danny Maddox, Teradata</span></div>
</div>
</div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com3tag:blogger.com,1999:blog-15757447.post-80584732341048993772011-10-19T14:31:00.000-04:002012-05-01T17:39:23.357-04:00Not All In-Database Analytics Are Created Equal<div style="color: #666666;">
Leading organizations differentiate themselves by analyzing massive amounts of interrelated data to predict business outcomes. High-volume, complex data analytics requires detailed data (not summaries) because influencing an individual’s actions requires that you track and analyze their unique interactions with your company. Traditional analytic systems and traditional databases cannot meet today’s need for predictive analytics on massive amounts of data.</div>
<div style="color: #666666;">
<br /></div>
<div style="color: #666666;">
It’s easy to overlook data movement when thinking about analytics and analytic performance. However, as data volumes increase, the simple act of moving data to an analytic engine dramatically decreases overall performance. To illustrate, a major credit card company takes two weeks to build its analysis files while an insurance company needs six days to perform this task. For many large-data analyses moving data consumes far more time than all other activities combined. I will compare traditional systems, comprised of physically separate database and compute servers, and various forms of contemporary analytic data warehouses. I will also note the types of analytics typically available to each analytic system.</div>
<div style="color: #666666;">
<br /></div>
<div style="color: #666666;">
Recognizing that database servers were not built for complex analytics, vendors paired a compute server with the database server. These traditional two-server analytic systems extract data from the database (either the data warehouse or the transactional database system) and move them onto another server, where they perform model building, model validation, and scoring processes. Moving a big data set from the database server to the analytic server is very inefficient and results in a large lag between the time data are created and their analysis. Beyond performance, this architecture has many challenges, including increased network load, overhead for analyst, demand for redundant infrastructure, data governance and synchronization issues, and data security concerns.</div>
<div style="color: #666666;">
<br /></div>
<div style="color: #666666;">
The next generation of analytic servers was driven by the need to minimize data movement. Most data warehouse vendors have built what they call in-database analytics. The main innovation was collocation of the compute and database engine to eliminate the need to copy data to another server for analysis. However, data must still be moved from disk to memory before the real analytics can happen. Moreover, the data transfers are not optimized – these systems must move entire tables even if only a subset of rows and columns is necessary to perform the analysis. And in many cases these data warehouses only offer SQL-based in-database analytics based like MIN, MAX, AVERAGE, and MEDIAN.</div>
<div style="color: #666666;">
<br /></div>
<div style="color: #666666;">
In terms of performance, the in-database stream processing architecture rises to the top. This architecture, found in the IBM Netezza data warehouse, eliminates the need to copy data to memory as data are analyzed as they stream off disk - minimizing data movement and data volume prior to scoring. Data minimization is accomplished with three capabilities: zone map technology and two types of filter technology. Zone map acceleration exploits the natural ordering of rows in a data warehouse to avoid scanning rows that are not relevant to the analytic query. Next, project and restrict engines eliminate columns and rows, respectfully. The IBM Netezza data warehouse appliance delivers unbeatable performance because it performs complex analytics as data streams off disk.</div>
<div style="color: #666666;">
<br /></div>
<div style="color: #666666;">
Many large-data analytics processes lack performance due to data movement. Traditional two-server solutions must move data within the database server and then over a network to the analytic server. General purpose data warehouses eliminate data movement across a network by collocating database and analytics servers, but are still hampered by copying data from disk to memory before scoring. High performance analytics servers take advantage of a stream processing architecture to eliminate unnecessary data movement. In other words, by using the IBM Netezza stream processing architecture, the credit card and insurance companies would immediately recognize performance gains of two weeks and six days, respectively. I hope this blog post helps you see that not all in-database analytics solutions are optimized for large-scale data. I welcome your feedback and I’m happy to field questions.</div>Dwaine Snowhttp://www.blogger.com/profile/10372997952318701599noreply@blogger.com0