Using Fuzzy Code Search to Link Code Fragments in Discussions to Source Code

Using Fuzzy Code Search to Link Code Fragments in Discussions to

Source Code

Nicolas Bettenburg Stephen W. Thomas Ahmed E. HassanQueen’s University

Software Analysis and Intelligence Lab (SAIL)Kingston, Ontario, Canada

“Given enough eyeballs, all bugs are shallow.”

Eric S. Raymond - The Cathedral and the Bazaar

Which parts of the source code did

developers discuss?

Objective in this Study:

Which parts of the source code did

developers discuss?

Finding Associations of Discussions with Source Code Files

Objective in this Study:

Communication Repository

Source CodeArchive

Untitled 12-03-15 2:55 PM

this.opt_withObsolete = opt_withObsolete;}

/* (non-Javadoc) * @see main.IExperiment#getDescription() */public String getDescription() {

String description = "We want to run an experiment all those bug reports.\n\t"+ "We extract the complete stacktrace information to study fix

location and stacktrace interplay.\n\t";return description;

/* (non-Javadoc) * @see main.IExperiment#run() */public boolean run() {

final boolean DEBUG = Main.isCli_withDebugMessages();

// Select an appropriate database name on the server depending on the project demanded via command line options

String dbName = "";if (Main.getCli_project().equalsIgnoreCase("eclipse"))

dbName = "eclipse-december-2007";else {

System.out.println("We currently only support the Eclipse database!");

System.exit(0);}

// Create the Database ConnectionDatabaseConnector dbc = new DatabaseConnector(Main.getCli_dbHost(),

Main.getCli_dbUser(), Main.getCli_dbPass(), dbName);dbc.initialize();if (!dbc.connect()) {

System.out.println("Could not connect to database. Check host, port, username and password.");

System.exit(1);}

// Fetch a number of Bug Report unique IDs belonging to the following query

String setSelectionQuery = "SELECT DISTINCT bug_id FROM bugzilla_bugs WHERE bug_id > " + Main.getCli_startID() + " ORDER BY bug_id ASC LIMIT " + Main.getCli_amount();

int[] bugIDs = dbc.getIdSetByQuery(setSelectionQuery);int lastID = bugIDs[bugIDs.length -1];

if (DEBUG)System.out.println("* Attempting to fetch " + bugIDs.length + "

reports from " + Main.getCli_dbHost() + " starting with ID " + Main.getCli_startID());

// Collect the bug reports from the database using up to 100 parallel threads.

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

Source CodeArchive

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

TraceabilityLinks

org.eclipse.swt/Eclipse_SWT/win32/org/eclipse/swt/widgets/Button.java

Approaches in the Past

3Change Log Analysis

Information Retrieval

Lightweight Textual Analysis

Change Log Analysis

LUCENE-2297: allow reader pooling to be enabled (through IndexWriterConfig) even if you're not pulling NRT reader.

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

Change Log Analysis

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

Change Log Analysis

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

Bug Report #LUCENE-2297

Change Log Analysis

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

Bug Report #LUCENE-2297

Map<Integer, BugReport> bugReports = dbc.getReportsConcurrent(bugIDs, Main.isCli_withDiscussions(), Main.isCli_withAttachments(), true); // Instantiate Output Class // This time we will need to use some XML Outputter for the Stacktraces Experiment_Structural_Logger logger = new Experiment_Structural_Logger (); DataExportUtility dexutil = new DataExportUtility(); XMLOutputter outputter = new XMLOutputter(Format.getPrettyFormat()); Element rootElement = new Element("CVS"); // Process the Reports if (Main.getCli_project().equalsIgnoreCase("eclipse")) { for (int id : bugIDs) { } BugReport currentReport = bugReports.get(id); Element reportElement = new Element("Report"); Code

DescriptionJared Burns 2002-11-01 14:56:40 ESTBuild 20021031(, 30, and 29)Linux-GTK

Very often (in recent builds), when I perform an action that requires establishing a connection to the dev.eclipse.org CVS server, the progress dialog appears but it stalls before any progress is made. I have to hit Cancel, wait 10+ seconds (I just switch apps), and then try again or it neverconnects.

This happens to me most often when I click the "Synchronize all CVSprojects..." button. The dialog appears and says "Authenticating overextssh", but the progress monitor never budges.

Discussion

I20041130-0800

Wrong compiler error when interface overrides two methods with same signaturebut different thrown exceptions: The call to ij.m() is OK, but eclipse flags itwith "Unhandled exception type IOException".

public class Over { void x() throws ZipException { IandJ ij= new K(); ij.m(); //wrong compile error } void y() throws ZipException { K k= new K(); k.m(); }}

interface I { void m() throws IOException; }interface J { void m() throws ZipException; }interface IandJ extends I, J {} // swap I and J to make compile error disappearclass K implements IandJ { public void m() throws ZipException { } }

I20041130-0800

Over.java

ZipException.java

IOException.java

I.java J.javaK.java

Change Log AnalysisXOnly works for Bug ReportsGeneralizeability:

Associates complete discussion threadGranularity:Link to all files changed in commitPrecision:

Ignores the actual discussions!Conceptual Mismatch:

Works for all kinds of documentsGeneralizeability:Which granularity level to choose?Granularity:

Lots and lots of false positives!Precision:Links unrelated documents!Conceptual Mismatch:

Information RetrievalX

Works for all kinds of documentsGeneralizeability:Which granularity level to choose?Granularity:

Lots and lots of false positives!Precision:Links unrelated documents!Conceptual Mismatch:

Information RetrievalX

Works for all kinds of documentsGeneralizeability:Very fine-grainedGranularity:

Up to 95% precision [Bacchelli-ICSE10]Precision:Links to every class mentionedConceptual Mismatch:

Lightweight Textual AnalysisX

In this Paper:Fuzzy Code Search

I20041130-0800

Over.javaZipException.java

IOException.javaI.java J.javaK.java

I20041130-0800

X.java

Y.java

Discussion

Fuzzy Code SearchApproach

Discussion

infoZilla tool

Discussion

infoZilla tool

Code Fragments

Discussion

infoZilla tool

Code Fragments

Clone DetectionPage 2 of 4

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

System.exit(0);}

System.exit(1);}

Evaluation of our Approach

1) QuantitativeDo developers talk about the things they end up changing?

Evaluation of our Approach

1) QuantitativeDo developers talk about the things they end up changing?

2) QualitativeWhich parts of the code do developers talk about the most?

Change-Log Analysis Fuzzy Code Search

Case Study: Eclipse 2.0 - 3.2

16,722 23,079Discussions Files

3,865Discussions

13,581Files

A BQ: Is A a Superset of B ?

3,865Discussions

13,581Files

Bug Reports (211,843)

Bug Reports containing Code (33,301)

Clone DetectionBased Approach

(2,980)

Change Log AnalysisBased Approach

(16,722)

Clone DetectionBased Approach

(2,980)

(16,722)

507Clone DetectionBased Approach

(2,980)

(16,722)

507Clone DetectionBased Approach

(2,980)

Very small overlap: Links are

conceptually different!

In Eclipse: heavy re-use of code

snippets to create regression tests.

Fuzzy Code Search

Fuzzy Code SearchFinds conceptually different links:

What Developers really talk about

Not what they end up changing

Not what their code references

Thanks!

Using Fuzzy Code Search to Link Code Fragments in Discussions to Source Code

Education

RED FRAGMENTS

True Source March 2012 - Checkmarx€¦ · implement secure software development for in-house and outsourced code. In recent ... A TSCA tool is capable is scanning code fragments

FRAGMENTI | FRAGMENTS

Android Fragments

Mina: Fragments

PL/SQL code fragments into Spring Batch configuration … · PL/SQL code fragments into Spring Batch configuration via ... com/a/eclipselabs.org/p/plsql ... fragments into Spring

Functional Baby Talk: Analysis of Code Fragments from ...€¦ · Functional Baby Talk: Analysis of Code Fragments from Novice Haskell Programmers Jeremy Singer and Blair Archibald

Granular Fragments

Avoiding Fragments

Genizah Fragments

public.dhe.ibm.compublic.dhe.ibm.com/software/integration/wmq/docs/V... · Bindingsmode............52 Defining which connection to use ......52 Example code fragments ..........52

This page intentionally left blank - pudn.comread.pudn.com/downloads167/ebook/769401/Kernel Methods... · 2008-09-27 · Code fragments 5.1 Matlab code normalising a kernel matrix

Sentence Fragments Overview - What is a “fragment” - Types of fragments - How to fix fragments - Activity

Les Fragments

An Empirical Study of Developer Discussions on Low-Code

Sentence fragments

Immigration: Debates and Discussions Class Discussions Discussions

Bag-of-Fragments: Selecting and Encoding Video Fragments ...isis-data.science.uva.nl/cgmsnoek/pub/mettes-bag-of-fragments-icmr2015.pdf · Bag-of-Fragments: Selecting and Encoding

Eneida fragments

FUN WITH FRAGMENTS Exploring Sentences and Sentence Fragments