What is FEASIBLE?
FEASIBLE is a customized SPARQL benchmark generation framework based on query logs of the RDF datasets.
How to generate a benchmark?
Just as a startup, you may directly click on the Generate button to generate a benchmark of 5 queries from DBpedia query log. In the pop-up window you will get the list of queries along with different query features such as number of query triple patterns, resultsize etc. Also you will see the Voronoi diagram of the generated benchmark along with the Mean, Standard Deviation, and Composite errors values. Please refer to the paper for the details of these error values.
How to generate a customize benchmark?
You can customize your benchmark by applying filters on SPARQL clauses (left most panel), basic query types (middle panel), and query features (left panel). For example, if you want to generate a custumize benchmark with the following filters.
First you need to only check SELECT checkbox from the middle panel. Then, click on select DISTINCT and FILTER check boxes from left panel and click on Add button. You will see your filter in the text area below the Add button. Then click on GROUPBY checkbox and add to the combination as well. At this stage the text area should contains (DISTINCT AND FILTER) OR (GROUPBY). Then check Result Size check box from the left panel and provide minimum value of 100. Finally, click on Triple Patterns Count checkbox and specify minimum 2 and maximum 5 and click on Add button. You will see (ResultSize >= 100 AND TriplePatternsCount >= 2 AND TriplePatternsCount <= 5) combination will be added to the text area. Specify the number of queries you want and click on Generate button. You can check that the above combinations of filters will be satisfied by each of the benchmark query. You can basically generate any type of benchmark by using disjunctive normal forms of the SPARQL clauses and query features. You can also write your filters manually in the textareas.
- All the queries must be of type SPARQL SELECT
- All the queries must contains both DISTINCT and FILTER clauses or the GROUP BY clause
- Result Size should be greater than 100
- The number of Triple Patterns should be between 2 and 5
How can I add a new query log?
You need to first convert your query log into FEASIBLE readable format and then upload here. For the conversion, you can use FEASIBLE clean queries generation utility provided at project homepage.
Project home page, source code, complete evaluation results, and issues
Note: Currently, we have imposed a limit of 50 queries. If you want more queries please checkout source code from project home page https://github.com/AKSW/feasible. If you have noticed any issue, feel free to report it by using the issue tracker given at project home page.