PowerPoint Presentation

MAHATMA GANDHI INSTITUTE OFTECHNICAL EDUCATION &RESEARCH CENTREA Seminar Presentation on,Sikuli Script

By,

SNEHAL M PATELE-mail: sne007@ymail.com

How to instruct computers, For doing Specific Task?

Shell Script , Codding ?

Dont Know the Good Programming ?Want to automate something, but Dont have an access to its source ?Want to Avoid Repeating, Boring or Annoying Codding ?

An Introduction to.

Sikuli Script was developed by User Interface Design Group, MIT Computer Science and Artificial Intelligence Laboratory (CSAIL).The developer behind this project are...General Introduction:

Sikuli Script is the new way to Program anything on your computers.What is Sikuli Script ?Sikuli is a visual technology to search and automates graphical user interfaces (GUI) using images (screenshots). It automates anything you see on the screen without internal API's support. You can programmatically control a web page, a desktop application running on Windows/Linux/Mac OS X, or even an iphone application running in an emulator.

Sikuli means "Gods Eye" in the language of native Mexicans.what you see is what you script

Platform Independense Virtual machinesRemote desktopMobile simulators: Android, iPhoneWeb: Flash, HTML + JavascriptWorks on ANY GUI that can be displayed on Windows / Linux / MacPROGRAM AGAINST UISikuli programs are written against the user interface instead of an API.

How it Works ?Combination of GUI & Traditional CodingJython coding that can use images as parameters and variablesScreen Capture utilized for image selectionCan upload image files

How it Works ?Taking Screenshot

CODE EDITORHow it Works ?

Take Screen ShotsInsert Image

Select region

Execute ScriptMaking Program

Need of Sikuli Script ...Allows programmer to make visual references instead of using names or keywords.More intuitive and natural approach.i.e. a child pointing to a cookie jar for a cookiewhen unable to ask for a cookie.Useful for specific applications that involve manipulation of GUI.

ApplicationExecution of Repeated TaskChanging System SettingsResetting IP AddressMonitoringConstantly looks for a specific change on screenDefense against hackingTest site by repeatedly attacking the site, etc. without having to do it yourselfVisually search the content in a Document

Monitoring a Baby

Sikuli Script in Real World...

Sikuli Script in Real World...Checking new status messages on Facebook

Limitation Currently, Sikuli Script operates only in the visible screen space and thus is not applicable to invisible GUI elements, such as those hidden underneath other windows, in another tab, or scrolled out of view.Dealing with moving, animated objects was hard.

Future DevelopmentTo automate scrolling or tab switching actions to bring the GUI elements into view to interact with it visuallyFast and accurate OCR on screenAccessibility API integrationWho is Using ?

Digital Arc SystemPlus many more.

Referenceshttp://sikuli.orghttp://blog.sikuli.org/http://hcc.cc.gatech.edu/documents/http://groups.csail.mit.edu/uid/sikuli/http://sikuli.csail.mit.edu/demo.shtmlhttp://downloadsquad.switched.com/2010/01/30/sikuli-uses-screen-shots-to-run-scripts-is-amazing/http://www.makeuseof.com/tag/create-automation-scripts-easily-screenshots/

Thank You....If any Questions then, contact me on: sne007@ymail.com