What’s Cool About DataGravity? Michael White – Director, DG Labs & Customer[0], DataGravity,...

What’s Cool About DataGravity?

Michael White – Director, DG Labs & Customer[0], DataGravity, Inc.vExpert Webinar – 8/5/15

4

Agenda• What is DataGravity Discovery Series?

• Version 2 New features– Custom tags

– Syslog

– Subscriptions

– Content alert

• Log Insight Content Pack

• vRealize Operations Management Pack

• Questions and Answers

• Conclusion

• (Appendix)

DataGravity Discovery Series?

6

A New Class of Storage

DataGravity Engine built into second node

• Protects data• Tracks activity• Extracts content

Puts idle resources to work

Mines data at point of storage

No impact on production IO!

Intelligence Node

DataGravity EngineProduction IO

Primary Node

HA

7

Intelligence Node

DataGravityEngine

DataGravityEngineProduction IO

Primary Node

Store, Protect, Analyze Data in Integrated System

Solid state cache-accelerated IO

HA stream written to separate pool of disks• All disk IO and computation are isolated• DiscoveryPoints are protected from failure

Hard disk drives dynamically allocated to one of two pools

HA

8

WHO is accessing what?

WHAT files are being changed?

WHEN is activity occurring?

WHERE is sensitive data located?

WHY are we running out of capacity?

Why Storage?

Directory ServicesIntegration

Data-Aware Storage?

9

Track data as it is used

• Track data creation, changes and user access activities throughout data’s life

Optimize data as it is written

• Store and serve data - via NFS, CIFS, iSCSI, VM-aware datastores

• Compress data inline

• Deduplicate VM’s inline

Protect data as it is stored

• Record instantly recoverable copies without impacting production

The DataGravity Data Flow

Find data as it is needed

• Automatically create a searchable data repository

• Query by content, time, user, and activity

10

Bringing Data Intelligence to VMware

In all other storage systems, the virtual machine is a virtual black box

virtual black box=

DataGravity enables full visibility into your data across your virtualizedenvironment

Who is accessing the data?What is in the VM? In the data?When is data being accessed?How is it being used?

What is New in Version 2

12

What is NEW in v2.0?

As a result of user input, here’s a short list of new stuff.

• More Tags – pre-defined and user-defined • Log forwarding via syslog• Subscriptions • Content Alerts

• And a lot more…

13

What is New in v2.0 – Custom tags

• AKA as user-defined tags

• While you can search for anything you want, and

• You have pre-defined tags for cool things like CC, SSN

• Now you can define your own tags.

• This means while the array cracks VMs, and files, it will be watching for what you think is important, and tag it for future use!

• 5 system tags (like v1), plus additional 4 new sample tags included

14

What is New in v2.0 – Tags

15

What is New in v2.0 – Log forwarding via syslog

• You can now forward the user visible logs via syslog

• Audit Log, and System Events are forwarded

Samples would include:• Log on, Log off• Log forwarding related• Creating / Updating Saved Searches• DiscoveryPoint activities• Mostly user activities

16

What is New in v2.0 – Subscriptions

• You can save a search for use later.

• You can save a search as public or private.

• But if it is public you can use it to create a subscription.

• You can chose frequency (hourly, daily, weekly, monthly) and mount points.

• You will be notified via email when it finds things.

17

What is New in v2.0 – Subscriptions

18

What is New in v2.0 – Content Alerts

• A public subscription can be used to create a content alert

• When a content alert fires it delivers via syslog.

• You choose saved search, mount points, and severity

• The purpose is to have the search occurrence generate an log event not just email

• The content alert fires on the schedule of the subscription.

19

What is New in v2.0 – Content Alerts

Log Insight Content Pack

21

Log Insight Content Pack

“vRealize Log Insight delivers real-time log management for VMware environments, with machine learning-based intelligent Grouping, high performance search and better troubleshooting” – thanks for that VMware!

So VMware knows all about VMware, but with the DataGravity Content Pack, LI will know all about DataGravity arrays!

22

Log Insight Content Pack

vRealize Operations Management Pack

24

vRealize Operations Management Pack

• “Automate IT operations management, manage performance and gain visibility across physical and virtual infrastructure with vRealize Operations” – thanks VMware.

• People use vROps to manage capacity, and performance of virtual machines / hosts / datastores.

• Green is good, and red is not.

25

vRealize Operations Management Pack

• The DataGravity MP provides context and relationship info to existing objects in vROps including DataGravity objects.

• Provides typical storage management info such as capacity, trending and performance information

• Also provides compliance information!

• Technical preview of Actions was demoed, but will not ship with MP

26

vRealize Operations Management Pack

Q & A

28

Questions and Answers

• Is this your average storage? Not!

• When available? Now.

• How many file types can you crack – hundreds and hundreds!

• What booth are we in at VMworld? 1928

• Is there a max number of custom tags? Yes – 20 is the max.

• Can tags be grouped together? Yes, into Intelligence Profiles.

• Does the two disk pool mean you have 100% overhead? Not exactly as one pool has your production data, and the other pool has backups and metadata.

29

Questions and Answers

• Is version 2 only new software or is there new hardware appliances? Version 2 is new software but there is also a new appliance – DG1100.

• Is there any plans for future event notification types – like Webhooks or REST posts? Yes, there are plans.

• How can DataGravity compliance match HIPAA or DISA/STG? DataGravity is not a compliance tool that maps to HIPAA or other standards. It is however, a very useful tool to help with compliance work.

• Is there encryption in the DataGravity product? Not at this time.

30

Questions and Answers

• Is there user auditing built into the DataGravity array? Yes.

• What protocols are supported – SMB (CIFS), iSCSI, NFS, and NFS datastores which are made for VMware virtual machines.

• Is there any plans for a vRO plug-in? We are always looking for good ideas.

• What effect does tagging have on the production data? None, as it happens on the Intelligence side.

• Now that you have a Content Pack for Log Insight what is next? Splunk, Solarwinds or what? Our customers will help us decide this.

31

Questions and Answers

• What is done in the array for data protection? RAID6 with Reed-Solomon erasure coding. High performance Intel libraries for GF multiplication and XOR generation based on research of James Plank, et al.

Thank you

Appendix

34

What is New in v2.0 – the full list

• More Performance • Custom Tags, more predefined tags, & False positive tag management• Audit User• Selective search, discovery, and activity tracking• Upgrades – online!• Log forwarding via syslog• Sub-folder mount points• Subscriptions and Content Alerts• vR Ops Management Pack, and Log Insight Content Pack• And more!

35

Useful Links

• ESXi Advanced Settings – http://notesfrommwhite.net/2015/02/10/updating-esxi-host-advanced-settings-using-powercli/

• Distributing DG Tools – http://notesfrommwhite.net/2015/08/12/use-active-directory-to-install-an-msi-that-needs-a-transform/

• DataGravity articles at Maentz.net - http://www.maentz.net/?tag=DataGravity

• DataGravity articles at Notesfrommwhite.net - http://notesfrommwhite.net/tag/datagravity

• DataGravity corporate resources - http://datagravity.com/resources• DataGravity Content Pack - http://notesfrommwhite.net/2015/08/17/introducing-the-

datagravity-content-pack-v1-0-for-log-insight/

36

Screenshots

37

What is New in v2.0 – Tags

38

What is New in v2.0 – Tags

39

What is New in v2.0 – Tags

40

What is New in v2.0 – Log forwarding via syslog

41

What is New in v2.0 – Subscriptions

42

What is New in v2.0 – Subscriptions

43

What is New in v2.0 – Subscriptions

44

What is New in v2.0 – Subscriptions

45

What is New in v2.0 – Content Alerts

46

What is New in v2.0 – Content Alerts

47

Log Insight Content Pack

48

Log Insight Content Pack• Need screenshot of content pack

49

vRealize Operations Management Pack

50

vRealize Operations Management Pack

51

vRealize Operations Management Pack

Thank you!