Information Lifecycle Dhawal Himani & Hitasha

Embed Size (px)

Citation preview

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    1/23

    An Oracle White Paper

    June 2007

    Information Lifecycle Management for

    Business Data

    Presentation by:

    Dhawal Kirti Maheshwari

    Himani Garkoti

    Hitasha Goswami

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    2/23

    Introduction

    eptember 28, 2010 Information Lifecycle Management for Business Data 2

    There are 2 objectives IT managers are trying to satisfy:

    To store vast quantities of data, for the lowest possible cost

    To meet the new regulatory requirements for data retention

    and protection.

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    3/23

    What is ILM?

    y Information Lifecycle Management (ILM) is designed to

    address these issues, with a combination of processes,

    policies, software and hardware so that the appropriate

    technology can be used for each phase of the lifecycle of the

    data.

    September 28,

    20103

    Information Lifecycle Management for Business Data

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    4/23

    The lifecycle of data

    y Active

    y Less active

    yHistorical

    y Archive

    S

    eptember 28, 20104

    Information Lifecycle Management for Business Data

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    5/23

    Why Oracle database 11g for

    business ILM

    It is much easier to manage, because the data is all in one

    place, instead of being stored using many different formats.

    the Oracle database is the ideal platform to implement an

    Information Lifecycle Management policy, because it has anumber of features, which makes it very easy to implement

    an ILM solution:

    Application Transparency; data classification is transparent

    Fine-grained; managing data at individual row level

    Low-Cost; uses low cost to reduce costs

    Enforceable Compliance Policies; define and enforce policies

    September 28,

    2010 5Information Lifecycle Management for Business Data

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    6/23

    y Application Transparency is very important in ILM, because itmeans that there is no need to customize applications and it

    also allows various changes to be made to the data without any

    impact on the applications that are using that data.

    y fine-grained levely low cost storage

    y compliance reasons

    September 28,

    20106

    Information Lifecycle Management for Business Data

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    7/23

    Implementing Information Lifecycle

    Management

    Step1. Step 2. Step 3. Step 4.

    Define the

    dataclasses

    Create

    storage

    tiers fordata

    classes

    Create

    data

    access &migration

    policies

    Define &

    enforce

    compliance policies

    September 28,

    2010 7Information Lifecycle Management for Business Data

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    8/23

    Step1-Define the data classes

    Determine the following while defining the data classes:

    y Which data is important, where is it and what needs to be

    retained.

    yHow this data flows within the organization.

    y What happens to this data over time and is it still needed.

    y The degree of data availability and protection that is needed.

    y Data retention for legal and business requirements.

    September 28, 20108

    Information Lifecycle Management for Business Data

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    9/23

    Step1-Define the data classes

    Data canbe bytheir ageor dateor both

    Classification

    Data hasto bephysicallyseparated

    Separation

    Data has

    to begroupedat rowleveldepending ontheir class

    Grouping

    tember 28, 2010 9Information Lifecycle Management for Business Data

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    10/23

    Example of defining data classes

    S

    eptember 28, 201010

    Information Lifecycle Management for Business Data

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    11/23

    Step2- Create storage tiers for data

    classes

    It is required toremove data fromdatabase & store it inother format

    All the data that isnever or hardlyaccessed would bestored.

    The less frequentlyaccessed data is stored,eg orders for Q2,Q3 and Q4.

    All the importantand frequentlyaccessed data isstored, eg

    Q1 orders.

    Highperformancestorage tier

    Low coststorage tier

    Offlinearchive

    storage tier

    Onlinearchive

    storage tier

    tember 28, 201011

    Information Lifecycle Management for Business Data

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    12/23

    Step2- Create storage tiers for data

    classes

    y The cost will be saved resulting from the usage of multiple tiered

    storage.

    y Once the storage tiers have been defined the data classes

    (partitions) identified in step one can be assigned to theappropriate storage tiers.

    y The data is distributed across the appropriate storage devices

    depending on its usage, while still keeping the data online and

    readable available and stored on the most cost-effective device.

    y Since partitioning is completely transparent to anyone accessing

    the data, no applications changes are required, thus it can be

    implemented at any time at minimal cost.

    S

    eptember 28, 2010 12Information Lifecycle Management for Business Data

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    13/23

    Step 3 Create Data Access and

    Migration PoliciesManaging Access to Data

    y By Using Oracle Database 11g asecurity policy is implemented viavirtual private database thatdetermines exactly which data canbe seen, therefore authorized users

    could see the information for Q1,Q2, Q3 and Q4, but only specialusers could view the historical data.

    y A security policy is defined at thedatabase level and it is transparentlyapplied to all database users.

    yThe benefit of this approach is thatit provides a secure and controlledenvironment for accessing the data,which cannot be overridden andcan be implemented withoutrequiring any application changes.

    y Migrate Data between Classes

    y During the lifecycle of the data itwill be necessary to move it atvarious times .

    y Within Oracle Database 11g, there

    are a number of ways that data canbe physically moved within thedatabase to take advantage of thedifferent storage tiers

    y Sometimes individual data itemsmust be moved rather than a groupof data.

    eptember 28, 201013

    Information Lifecycle Management for Business Data

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    14/23

    Step 4 Define and Enforce

    Compliance Policiesy Defining compliance policies for data which is stored at one central

    location in oracle database is easier.

    y The following areas are to considered while defining the compliance

    policies.

    Retention

    ( for how long the datahas to be kept)

    Immutability

    (assigning an externalparty that data is

    complete & it has notbeen altered)

    Privacy

    (security policies aredefined using virtual

    private database)

    Auditing

    (Oracle database hasauditing capabilities to

    track all access andchanges to data)

    Expiration

    (oracle database removedata very quickly by

    dropping the partitions)

    September 28, 201014

    Information Lifecycle Management for Business Data

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    15/23

    S

    eptember 28, 2010 Information Lifecycle Management for Business Data15

    GUI based tool.

    Used for managingILM environment

    Oracle ILM

    Assistant

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    16/23

    Basic Requirements:

    September 28,

    2010 Information Lifecycle Management for Business Data16

    y Oracle Database 9i or greater

    y

    OracleA

    pplication Express must be installed in thedatabase where the tables reside

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    17/23

    September 28, 2010 Information Lifecycle Management for Business Data 17

    y ILM Assistant provides the ability to create lifecycle definitions.

    y These definitions are assigned to tables in the database.

    y Then based on the lifecycle policy, the ILM Assistant advises when it is

    time to move, archive or delete data.

    y The storage requirements and cost savings associated with moving the

    data is also illustrated.

    y Other capabilities include the ability to show how to partition a table

    based on a lifecycle definition and to simulate the events on a table if it

    were partitioned.y To assist with managing compliance issues, the ILM Assistant will show

    all VPD and FGA policies that have been defined. It can also display and

    query all the audit records and generate and compare digital signatures.

    Features:

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    18/23

    September 28, 2010 Information Lifecycle Management for Business Data

    18

    TraditionalView

    Data should be removed from the database and stored on tape,because tapes are capable of storing vast quantities ofinformation for a very low cost

    Data needs to be archived out of the database in order tomaintain the performance of the database

    Reluctance in some organizations to remove data from the

    database.

    Modern View

    Data can remain in the database, or transferred to a centralonline archive database. All this information would be storedusing low-cost storage devices

    Databases can perform extremely well with huge quantities ofdata

    if there is no legal requirement to retain the data, why keep itwhen it is no longer required

    Online archives

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    19/23

    Benefits of online archives

    September 28, 2010 Information Lifecycle Management for Business Data 19

    y Data will always be instantly available, therefore time is not wasted

    trying to locate the tapes.

    y No worrying as to whether the tape is readable and still in a

    format that can be loaded into the database.y Retrieval of data from databases could prove expensive, and time-

    consuming if the data is extremely old.

    y Holding all the historical data in the database no longer impacts

    the time required to backup the database and the size of the

    backup.

    y Data remains online when needed hence faster access to meet the

    business requirements

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    20/23

    Removal of data

    September 28, 2010 Information Lifecycle Management for Business Data 20

    Keep the data in its ownpartition and then dropthe partition when it is

    time to remove that data

    from the database.

    Remove the data in a

    database format such as atransportable tablespaceor extract the information

    in an open format.

    No legal

    requirement

    to retain the

    data

    Data may haveto be returned

    to the database

    in future

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    21/23

    Conclusion

    September 28, 2010 Information Lifecycle Management for Business Data 21

    y Oracle Database 11g provides an ideal platform for

    implementing ILM.

    Simple to use since there are no specialized data stores to manage and it

    operates independent of any hardware.

    It has proven fast performance

    The data is secure from unauthorized access and data is always

    transactionally consistent.

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    22/23

    tember 28, 2010 Information Lifecycle Management for Business Data 22

    y The Oracle Database provides total flexibility

    Can rapidly adapt to any change in requirements..

    It is possible to define what should happen to data during its lifetime and

    be reminded when it is time to perform those actions.

    The Oracle Database has already been around for over 20 years, which is

    very reassuring when your data may have to be retained for a long

    duration.

  • 8/8/2019 Information Lifecycle Dhawal Himani & Hitasha

    23/23

    tember 28, 2010Information Lifecycle Management for Business Data 23

    y Information Lifecycle Management enables us to understand

    our data, which is an extremely valuable business asset,which must be managed properly, to ensure business success

    and regulatory compliance. Using Oracle Database 11g, a

    comprehensive ILM solution can be implemented for the

    lowest possible cost.