# Virtual Graph over Spark SQL

**URL:** <https://community.stardog.com/t/virtual-graph-over-spark-sql/3879>\
**Category:** Support\
**Created:** [July 19, 2022, 8:17pm UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879 "2022-07-19T20:17:39Z")\
**Posts on this page:** 20\
**Page:** 1

<div class="post-metadata">

**Author:** ![lambdakris](https://yyz2.discourse-cdn.com/flex030/user_avatar/community.stardog.com/lambdakris/32/1013_2.png) [@lambdakris](https://community.stardog.com/u/lambdakris)\
**Post date:** [July 19, 2022, 8:17pm UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/1 "2022-07-19T20:17:39Z")

</div>

Hello, I am trying to understand whether it is possible to create a Virtual Graph over just plain Spark SQL without Databricks. If yes, would anyone be able to provide some guidance as to how exactly this can be accomplished? Would it be necessary to set up Spark as a Distributed SQL Engine, or does Stardog's Graph Virtualization tech somehow manage to generate and submit a Spark SQL job to the Spark cluster?

Thanks in advance!

---

<div class="post-metadata">

**Author:** ![Cathy\_Dalzell](https://yyz2.discourse-cdn.com/flex030/user_avatar/community.stardog.com/cathy_dalzell/32/1202_2.png) [@Cathy\_Dalzell](https://community.stardog.com/u/Cathy_Dalzell)\
**Post date:** [July 20, 2022, 12:43am UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/2 "2022-07-20T00:43:28Z")

</div>

Hello Kris,

I'm sure we can help you out, but we would need more details about where your data live. Strictly speaking, even with Databricks, virtual graphs do not connect Stardog to Spark SQL - they connect Stardog to some kind of persistent storage system - which could be the Databricks Delta Lake, or an Oracle DB, or something else. If I have understood it correctly, Spark is basically a distributed analytics engine that accesses and manipulates data from an underlying distributed system -- sometimes Hadoop, sometimes not.

Stardog is not limited to Databricks by any means. How are you currently storing your data?

Catherine

---

<div class="post-metadata">

**Author:** ![PaulJackson](https://yyz2.discourse-cdn.com/flex030/user_avatar/community.stardog.com/pauljackson/32/243_2.png) [@PaulJackson](https://community.stardog.com/u/PaulJackson)\
**Post date:** [July 20, 2022, 12:52pm UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/3 "2022-07-20T12:52:10Z")

</div>

Couple things to add in addition to Catherine's reponse:

The interface between Stardog and Spark is a Java JDBC driver, for which you can use Databrick's driver, at least for now. We currently test Spark with version 22 of their driver. You can download it here: [https://databricks.com/spark/jdbc-drivers-archive](https://databricks.com/spark/jdbc-drivers-archive)

Aside from that connection, you'll need to create table on the Spark side - see: [CREATE TABLE - Spark 3.3.1 Documentation](https://spark.apache.org/docs/latest/sql-ref-syntax-ddl-create-table.html)

Once that's done you can create a virtual graph following this: [Virtual Graphs | Stardog Documentation Latest](https://docs.stardog.com/virtual-graphs/)

-Paul

---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [August 2, 2022, 9:59am UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/4 "2022-08-02T09:59:11Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [August 15, 2022, 10:25pm UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/5 "2022-08-15T22:25:33Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [August 29, 2022, 7:20pm UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/6 "2022-08-29T19:20:18Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [September 12, 2022, 3:50pm UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/7 "2022-09-12T15:50:01Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [September 26, 2022, 8:43pm UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/8 "2022-09-26T20:43:47Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [October 11, 2022, 12:48am UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/9 "2022-10-11T00:48:59Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [October 25, 2022, 6:41am UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/10 "2022-10-25T06:41:52Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [November 10, 2022, 9:00pm UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/11 "2022-11-10T21:00:48Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [December 2, 2022, 10:02pm UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/12 "2022-12-02T22:02:50Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [December 27, 2022, 6:30am UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/13 "2022-12-27T06:30:18Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [January 23, 2023, 8:55am UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/14 "2023-01-23T08:55:22Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [February 20, 2023, 11:29am UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/15 "2023-02-20T11:29:14Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [March 20, 2023, 7:01am UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/16 "2023-03-20T07:01:30Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [April 18, 2023, 6:11pm UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/17 "2023-04-18T18:11:04Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [May 19, 2023, 5:11am UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/18 "2023-05-19T05:11:20Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [June 20, 2023, 6:23pm UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/19 "2023-06-20T18:23:03Z")

</div>



---

<div class="post-metadata">

**Author:** ![system](https://canada1.discourse-cdn.com/flex030/uploads/stardog/original/2X/e/ed66b48a616f505106a4acde3c9cee7e6da9bc67.svg) [@system](https://community.stardog.com/u/system)\
**Post date:** [July 23, 2023, 10:04pm UTC](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879/20 "2023-07-23T22:04:02Z")

</div>



[Next page](https://community.stardog.com/t/virtual-graph-over-spark-sql/3879.md?page=2)
