Error with direct mapping

zachary.whitley · October 5, 2019, 1:15pm

I'm trying to generate a direct mapping and it's throwing an IllegalArgument exception. "Template must reference one or more variables: geometry_dump"

I don't believe I've got a column named geometry_dump so I'm assuming it's an internally generated variable. For now I'll just exclude tables until I figure out which one is causing the problem. I'm not really interested in mapping the geom at this point.

ERROR 2019-10-05 09:04:43,219 [stardog-user-1] com.complexible.stardog.virtual.DefaultVirtualGraphRegistry:createVirtualGraph(354): Cannot initialize virtual graph geonames
java.lang.IllegalArgumentException: Template must reference one or more variables: geometry_dump
        at com.google.common.base.Preconditions.checkArgument(Preconditions.java:141) ~[guava-26.0-jre.jar:?]
        at com.complexible.stardog.virtual.vega.mapping.UriTemplate.<init>(UriTemplate.java:137) ~[stardog-virtual-core-7.0.2.jar:?]
        at com.complexible.stardog.virtual.vega.mapping.TemplateTermMap.<init>(TemplateTermMap.java:88) ~[stardog-virtual-core-7.0.2.jar:?]
        at com.complexible.stardog.virtual.vega.mapping.MappingGenerator.getSubjectMap(MappingGenerator.java:119) ~[stardog-virtual-core-7.0.2.jar:?]
        at com.complexible.stardog.virtual.vega.mapping.MappingGenerator.generateTriplesMap(MappingGenerator.java:215) ~[stardog-virtual-core-7.0.2.jar:?]
        at com.complexible.stardog.virtual.vega.mapping.MappingGenerator.lambda$generateTriplesMaps$6(MappingGenerator.java:147) ~[stardog-virtual-core-7.0.2.jar:?]
        at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_222]
        at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_222]
        at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_222]
        at com.google.common.collect.CollectSpliterators$1WithCharacteristics.lambda$forEachRemaining$1(CollectSpliterators.java:64) ~[guava-26.0-jre.jar:?]
        at java.util.stream.Streams$RangeIntSpliterator.forEachRemaining(Streams.java:110) ~[?:1.8.0_222]
        at com.google.common.collect.CollectSpliterators$1WithCharacteristics.forEachRemaining(CollectSpliterators.java:64) ~[guava-26.0-jre.jar:?]
        at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) ~[?:1.8.0_222]
        at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_222]
        at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) ~[?:1.8.0_222]
        at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_222]
        at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566) ~[?:1.8.0_222]
        at com.complexible.stardog.virtual.vega.mapping.MappingGenerator.generateTriplesMaps(MappingGenerator.java:148) ~[stardog-virtual-core-7.0.2.jar:?]
        at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_222]
        at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) ~[?:1.8.0_222]
        at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482) ~[?:1.8.0_222]
        at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_222]
        at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708) ~[?:1.8.0_222]
        at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_222]
        at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566) ~[?:1.8.0_222]
        at com.complexible.stardog.virtual.vega.mapping.MappingGenerator.generateTriplesMaps(MappingGenerator.java:160) ~[stardog-virtual-core-7.0.2.jar:?]
        at com.complexible.stardog.virtual.vega.rdbms.RdbmsMappings.generateMappings(RdbmsMappings.java:248) ~[stardog-virtual-core-7.0.2.jar:?]
        at com.complexible.stardog.virtual.vega.rdbms.RdbmsMappings.parseOrGenerateMappings(RdbmsMappings.java:112) ~[stardog-virtual-core-7.0.2.jar:?]
        at com.complexible.stardog.virtual.vega.rdbms.RdbmsMappings.parseOrGenerateMappings(RdbmsMappings.java:107) ~[stardog-virtual-core-7.0.2.jar:?]
        at com.complexible.stardog.virtual.vega.rdbms.RdbmsMappings.parseOrGenerateMappings(RdbmsMappings.java:92) ~[stardog-virtual-core-7.0.2.jar:?]
        at com.complexible.stardog.virtual.vega.rdbms.RdbmsVirtualGraphFactory.create(RdbmsVirtualGraphFactory.java:80) ~[stardog-virtual-core-7.0.2.jar:?]
        at com.complexible.stardog.virtual.vega.rdbms.RdbmsVirtualGraphFactory.create(RdbmsVirtualGraphFactory.java:49) ~[stardog-virtual-core-7.0.2.jar:?]
        at com.complexible.stardog.virtual.DefaultVirtualGraphRegistry.createVirtualGraph(DefaultVirtualGraphRegistry.java:351) ~[stardog-virtual-core-7.0.2.jar:?]
        at com.complexible.stardog.virtual.DefaultVirtualGraphRegistry.createVirtualGraph(DefaultVirtualGraphRegistry.java:337) ~[stardog-virtual-core-7.0.2.jar:?]
        at com.complexible.stardog.virtual.DefaultVirtualGraphRegistry.add(DefaultVirtualGraphRegistry.java:196) ~[stardog-virtual-core-7.0.2.jar:?]
        at com.complexible.stardog.virtual.SecuredVirtualGraphRegistry.add(SecuredVirtualGraphRegistry.java:146) ~[stardog-virtual-core-7.0.2.jar:?]
        at com.complexible.stardog.protocols.http.server.virtual.admin.VirtualGraphHttpService.addVG(VirtualGraphHttpService.java:391) ~[stardog-virtual-protocols-http-server-7.0.2.jar:?]
        at com.complexible.stardog.protocols.http.server.virtual.admin.VirtualGraphHttpService.update(VirtualGraphHttpService.java:202) ~[stardog-virtual-protocols-http-server-7.0.2.jar:?]
        at com.stardog.http.server.undertow.jaxrs.ExtractRoutes.lambda$handleIt$5(ExtractRoutes.java:192) ~[stardog-protocols-http-server-7.0.2.jar:?]
        at org.apache.shiro.subject.support.SubjectRunnable.doRun(SubjectRunnable.java:120) [shiro-core-1.3.0.jar:1.3.0]
        at org.apache.shiro.subject.support.SubjectRunnable.run(SubjectRunnable.java:108) [shiro-core-1.3.0.jar:1.3.0]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_222]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_222]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_222]
ERROR 2019-10-05 09:04:43,230 [stardog-user-1] com.complexible.stardog.protocols.http.server.StardogHttpServiceLoader:accept(228): An exception was handled by the server: Template must reference one or more variables: geometry_dump

jess · October 5, 2019, 1:20pm

Are you able to export/share the schema for this db?

zachary.whitley · October 5, 2019, 2:40pm

Sure can. Some of the tables were creaed by importing some geojson with ogr2ogr tool.

schema.zip (2.1 KB)

jess · October 5, 2019, 5:07pm

Looks like we're picking up types when introspecting the metadata:

\d geometry_dump
        Composite type "public.geometry_dump"
 Column |   Type    | Collation | Nullable | Default 
--------+-----------+-----------+----------+---------
 path   | integer[] |           |          | 
 geom   | geometry  |           |          |

We ignore other types like sequences, but this is a TYPE. We'll get this fixed. I've created issue #7935.

As a workaround, you can set default.mapping.exclude.tables in your VG config file. The list of PostGIS types is addbandarg,agg_count,agg_samealignment,geometry_dump,geomval,rastbandarg,reclassarg,summarystats,unionarg,valid_detail. Hope this helps.

Jess

zachary.whitley · October 5, 2019, 5:30pm

Thanks. Another thing I've noticed is that when you export mappings all projections are checked for nullability ie. ...AND field1 IS NOT NULL AND field2 IS NOT NULL ...

It makes it appear as though a mapping with a single NULL field but I don't recall it actually working that way when actually querying a virtual graph for a row containing a filed with a null column.

jess · October 5, 2019, 5:32pm

Thanks, we found that bug and fixed it already. It will be included in the November release.

zachary.whitley · October 5, 2019, 5:34pm

oh and one last thing, I generated a default mapping without a base specified and it produced resources as if

BASE http://api.stardog.com

and I think I remember the documentation said that it would be virtual://myGraph

zachary.whitley · October 19, 2019, 5:34pm

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.

Topic		Replies	Views
Template must reference one or more variables: http://api.stardog.com/db_table/?c_id={?c_id} Support	7	376	July 10, 2019
Auto-generated Mappings Support	5	566	March 1, 2019
Trouble creating virtual graph mappings Support	3	279	November 15, 2021
Virtual graph import NPE Bug	5	757	February 23, 2018
R2RML VirtualGraphIterator Bug	3	569	December 22, 2017

Error with direct mapping

Related topics