Sybase Business Intelligence Solutions - Database Management, Data Warehousing Software, Mobile Enterprise Applications and Messaging
Sybase Brand Color Bar
  blank
 
 
 
 
 
 
 
 
 
 

Sybase IQ 15.1 – More than meets the eye…

Sybase announced Sybase IQ version 15.1 this week with some powerful new capabilities. Most noteworthy are 2 new in-database analytics capabilities, both game-changers if your needs include fast, easy, low-latency statistical analysis or predictive modeling. Also announced are new tools to speed reporting and simplify information lifecycle management.

Sybase IQ 15.1 speeds statistical analytics, at game-changing latency levels, by running complex analytic queries and statistical functions directly within Sybase IQ. In contrast to other approaches, Sybase IQ 15.1 does NOT require data to be moved outside the database into multi-dimensional structures and pre-aggregations in order to run HOLAP/MOLAP analyses.

In-database analytics contrasts with traditional approaches by slashing latency previously expended to move data from the database into multidimensional structures for analytic operations. Think of it as “cube performance without the cube engine”.

It gets better. Sybase IQ 15.1 also contains APIs through which Sybase will facilitate addition of plug-in routines for yet more in-database operations. The first partner to exploit the capability is Fuzzy Logix, LLC, who have certified plug-in analytic and modeling functions including monte carlo simulation, clustering analysis, neural networks and regressions. These facilities can now run directly inside Sybase IQ 15.1 engine, with direct access to data. This avoids expensive movement or denormalization of the data. These in-database capabilities promise to be “game changing” for real-time advanced analytics.

I can hear the question bubbling already. “We run these types of analytics now, so what’s new?” If this is your situation, ask your admin team how long it takes, after data is loaded into the database, for that data to be re-loaded into aggregate structures, either in the database or beneath the analytics tool they’re using. Ask them how much time they spend adapting cubes to fit the latest queries (or vice versa) and how often ad-hoc queries that fall beyond that data in the cube are drilling back into the RDBMS, killing performance for all users.

If you’re running complex analytics today, and need to cut latency or complexity, then you’re a candidate for leveraging the speed of in-database analytics.

But wait, there’s more!

Beyond in-database analytics, we’ll soon make complex VLDB management easier, with a new release Sybase PowerDesigner and it’s plug-in version for Sybase WorkSpace. These new VLDB capabilities arrive as part of new information lifecycle models in PowerDesigner version 15.1. They rely on object placement and table partitioning capabilities that are new with Sybase IQ 15, and makes those two powerful features GUI-based.

With these new capabilities in PowerDesigner, it’s easy to segregate new or frequently-used data onto your fast storage devices, and migrate aging or infrequently-used data onto lower-cost storage. This slashes the cost of storage by allowing you to concentrate your storage expenditures where it does the most good, and simplifies back-up processes to boot.

You will also find that Sybase’s eclipse-based tool framework, Sybase WorkSpace Data Analytics IDE, has been enhanced to include a very capable reporting services application called BIRT, from Actuate Corporation. BIRT is one of the best-known open-source business intelligence toolsets in market today, and its inclusion allows you to do more with less – less time and expense creating user visualization during the application development process.

And so, with two powerful new versions of Sybase IQ already released this year, plus new PowerDesigner and WorkSpace Data Analytics IDE capabilities, we’re hoping to make you the hero – the person who delivers real-time analytics and predictive modeling below budget, without working weekends, and perhaps one of the few people who have budget money left at the end of the year for a few well-earned bonuses for your team.

Bill Jacobs

Share and Enjoy:
  • Digg
  • Sphinn
  • del.icio.us
  • Facebook
  • Mixx
  • Google Bookmarks

14 Comments

  1. Kevin Sherlock says:

    Bill,
    This all sounds very exciting. Where can we find more technical information about 15.1 ? I can’t seem to find any further information about these “2 new in-database analytics capabilities”.

  2. Kevin Sherlock says:

    Bill,
    I can’t find any documentation on the new 15.1 features “2 new in-database analytics capabilities” you mentioned in the article. I’ve even downloaded 15.1 and the docs don’t have any “what’s new” information. Can you point us to any documentation on 15.1 that has the details ?

  3. Bill Jacobs says:

    Hi Kevin:

    Much of the new information is found in the New Features Guide that is included with the documentation set for version 15.1. Since you’re already a Sybase IQ user, you should have access to this information through your normal download channels. If not, hit me up via email and we’ll get you the information you need.

    Bill

  4. IQ ETL newbie says:

    Is there an IQ ETL demo in Video format or PPT file, just like youtube or something? I plan to use Sybase ETL to move data from MS SQL / MySQL over to IQ 127.

    Thanks

  5. Robert Wiebener says:

    I’ve forwarded you two powerpoints about ETL, a fast track to ETL presentation and new features in ETL 4.8. If you have further questions, please let me know, or post them here.

    If anyone else would like to see the powerpoints, just let me know!

    Robert

  6. KL Tan says:

    Bill,
    I would like to see the powerpoint. Can you forward to me also ?
    Thanks.

    KL

  7. admin says:

    Hi KL:

    Thanks for your interest – will send you the ETL powerpoint shortly.

    bill

  8. Aadi says:

    Rob/Bill

    Would it be possible to email me the powerpoints as well? We are currently doing a proof of concept on IQ to replace our Oracle data store.
    much thanks
    aadi

  9. admin says:

    Aadi:

    Yes, I will send it along separately.

    Bill

  10. Varun says:

    Can we take partition waise backup in iq 15. Any body please help me ..

  11. admin says:

    Hello Varun:

    Yes, it is possible to back-up individual table partitions in IQ15.1. Table partitioning requires the new VLDB option. There’s a brief summary of the VLDB option and the incremental backup it makes possible in this whitepaper.

    Once the VLDB option is licensed for your server, prepare for partition backups as follows:

    1) Partition the table using the partition command. [Your partitions will contain the complete rows - the segments of the FP index - within the partition range.]

    2) Using object placement commands, assign each table partition to it’s own DBSpace. [You'll be backing-up or duplicating these DBSpace to back-up the partition(s) of interest.]

    When you’re ready to back-up a the table partition of interest:

    3) Mark the DBSpace containing the partition as read-only.

    4) Back-up the DBSpace containing your partition, either using backup, or by duplicating it in the SAN or via OS commands.

    5) Back-up the read-write portions of the database. This is needed in order to restore the read-only table partition you’ve backed-up using this procedure, a step required to maintain database consistency. You might find Virtual Backup useful, as it makes for the smallest Sybase IQ back-ups, by backing-up only database metadata, but not table data, leaving thos bulky backups for duplication via SAN or OS commands. [You can read about virtual backup in this whitepaper. Note that the whitepaper was created prior to the existence of IQ15 and the VLDB option with partitioning, but the concept is the same.]

    Hope that helps, and feel free to post any follow-ups here.

    Bill Jacobs

  12. Varun says:

    Hi Bill,

    Thanks for your valuable advice.

    I will tell you the current status. We are planning to implement ILM.

    Dbspace information

    1) We have a dbsapce called DSP_Current (Hold 1 year of data, two partitions)

    2) Other than that we have 12 different dbspace for Historic data (6 years)
    That is h01, h02, h03……, h12 – Each one hold one partition 6 month of data

    If I want to take backup one of the dbspace and restore that backup to another dbspace with same size. Could you please help me to get the syntax of above situation?

  13. Courtney Claussen says:

    An encapsulated virtual backup (the best performing of the backup commands) backs up all of the an IQ database except the IQ store table data. You must make a separate operating system-level copy of the DBSpaces that make up the corresponding IQ store. To restore from a virtual backup, you must first restore the corresponding system-level copy of the IQ store and then proceed with the IQ full restore of the virtual backup. Here is an example of a virtual backup command:

    BACKUP DATABASE FULL VIRTUAL ENCAPSULATED
    ‘dd if=iqdemo.iq of=iqdemo.iq.copy’
    TO ‘iqdemo.full’

    When you restore, you do commands similar to the following:

    dd if =iqdemo.copy of=iqdemo.iq
    RESTORE DATABASE iqdemo.db FROM ‘iqdemo.full’

    With the new ILM features of IQ 15, you can segregate your read-write data to particular DBSpaces, so a backup can be even faster. If you have already backed up your readonly data once, you can backup on a regular basis just the DBSpaces that are changing.

    You say that you want to restore a DBSpace backup to another storage area of the same size. Since you are doing a virtual backup, and performing the OS level copies of the files yourself, you should be able to restore the data to a different area using the disk block copy utility pertinent to the particular platform. You would then have to update the metadata information about the particular DBSpace that moved when IQ starts up again, to point it to the new area of storage. You can do that through Sybase Central to change the properties of the DBSpace.

  14. Is there an IQ ETL demo in Video format or PPT file, just like youtube or something? I plan to use Sybase ETL to move data from MS SQL / MySQL over to IQ 127

Leave a Reply

Sybase privacy policy

*