News Operations
Browse Space| Module Maintainer: | Gabriel Roldán |
| Status: |  |
| Email Help: | Geotools-gt2-users@lists.sourceforge.net |
| Volunteer: | geotools-devel@lists.sourceforge.net |
| Plugin: | DataStore |
Plug-in provides access to an ArcSDE server for both vector and raster data.
Module Status
The arcsde module is stable for data reading for both vector and raster data.
The arcsde module is stable for transactional vector data modification. Does not support raster data modification.
The arcsde module is currently a part of the nightly build
The test suite is not being run as a part of the nightly build as there is no build profile which would connect it to a live SDE instance to perform tests.
Gold Star Quality Assurance Check
There are five 'support stars' to earn. In order to get the ArcSDE module to supported status, we need at least four, and eventually five.
| status | description |
| |
IP check, see review.apt |
| |
Releasable - has no blocking bugs in jira |
| |
Used in anger - Used by GeoServer or uDig on large real world datasets – used by MassGIS to serve the statewide landuse dataset. |
| |
Optimized - has been tuned to meet hard performance requirements (example shapefile) |
| |
Supported - user docs, module maintainer watches user list, answers email etc.. Javadocs could use a review. |
Recent Development (as of May 2009)
For the 2.6.x branch (trunk) arcsde raster support has been completely refurbished in order to support all the ArcSDE raster pixel depths, and any number of bands (with the exception of 4-bit rasters and 1-bit ones with more than one band), as well as colormapped rasters (8 or 16-bit rasters with a color pallete).
The vector support was also enhanced to perform really well under high concurrency.
All the changes in the 2.6.x series are being backported to the stable 2.5.x branch.
For the 2.5.x branch arcsde has been almost completely rewritten, it no longer extends AbstractDatatore and the code is much easier to follow. Internally it protects all SeConnection use behind a Queue (rather than a Lock) as a way of addressing concurrent usage in a fair manner.
Also, it has been extended to support the read and edition of versioned tables, limited to edit the default version.
For the 2.4.x branch arcsde is working on returning to supported status; we need to provide a profile for nightly builds to run. ArcSDE Raster Support is also available on 2.4.x as well. You can find out about it at the ArcSDE Raster Support page.
For the 2.3.x branch, there is an initial implementation of ArcSDE Raster Support. You can find out about it here.
For the 2.2.x branch the arcsde module has returned to the build process with a stub jar to replace ESRI dependencies.
IP Review
Please refer to:
Usage
For usage instructions please consult the ArcSDE Plugin page on the GeoTools User Guide.
Outstanding Issues
jira.codehaus.org
(22 issues)
|
||||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| T | Key | Summary | Assignee | Reporter | Pr | Status | Res | Created | Updated | Due |
|
GEOT-423 | createSchema needs the CRS's valid coordinate range | Gabriel Roldán | Gabriel Roldán |
|
 Open
|
UNRESOLVED | Feb 14, 2005 | Nov 15, 2006 | |
|
GEOT-1705 | Or'ed spatial filters are being and'ed instead | Gabriel Roldán | Gabriel Roldán |
|
Open
|
UNRESOLVED | Feb 12, 2008 | Jun 09, 2009 | |
|
|
GEOT-1776 | versioned edit tests fail to run against ArcSDE 9.2 | Gabriel Roldán | Saul Farber |
|
Open
|
UNRESOLVED | Apr 18, 2008 | Apr 18, 2008 | |
|
|
GEOT-1213 | Fid filter can geneate unsupported SQL on Oracle | Saul Farber | Shaun Forbes |
|
 Reopened
|
UNRESOLVED | Mar 29, 2007 | Jun 05, 2007 | |
|
|
GEOT-1194 | Polygon with holes not handled by | Gabriel Roldán | Lars Aksel Opsahl |
|
Open
|
UNRESOLVED | Mar 09, 2007 | Mar 16, 2008 | |
|
|
GEOT-1944 | Difference between FeatureBounds and FeatureCollectionBounds | Gabriel Roldán | Jody Garnett |
|
Open
|
UNRESOLVED | Aug 06, 2008 | Aug 06, 2008 | |
|
|
GEOT-1728 | ArcSdeDataStoreFactory.determineJsdeVersion missbehaves whith 9.2 database and 9.1 jars | Saul Farber | Gabriel Roldán |
|
Open
|
UNRESOLVED | Mar 14, 2008 | Sep 04, 2008 | |
|
|
GEOT-1394 | ArcSDE query.getCount() sometimes returns inaccurate result | Saul Farber | Tyler Erickson |
|
Open
|
UNRESOLVED | Jul 15, 2007 | Sep 04, 2008 | |
|
|
GEOT-362 | TransactionInsert not working through Geoserver | Gabriel Roldán | Cougar Jay |
|
Open
|
UNRESOLVED | Dec 25, 2004 | Sep 04, 2008 | |
|
GEOT-2470 | Reduce size of test-data for ArcSde raster | Gabriel Roldán | Simone Giannecchini |
|
Open
|
UNRESOLVED | May 01, 2009 | May 01, 2009 | |
|
|
GEOT-2522 | Unable to calculate query extent using Id filter | Gabriel Roldán | Shaun Forbes |
|
Open
|
UNRESOLVED | May 29, 2009 | May 29, 2009 | |
|
|
GEOT-2414 | Missing colors when going from the ArcSDE raster's color map to an IndexColorModel | Gabriel Roldán | Gabriel Roldán |
|
Open
|
UNRESOLVED | Mar 30, 2009 | Jun 09, 2009 | |
|
|
GEOT-2409 | Rename jsde_jpe_sdk dependency as jpe_sdk | Gabriel Roldán | Gabriel Roldán |
|
Open
|
UNRESOLVED | Mar 26, 2009 | Jun 09, 2009 | |
|
|
GEOT-2337 | Provide a means to get the list of available raster datasets for the ArcSDE GCE module | Gabriel Roldán | Gabriel Roldán |
|
Open
|
UNRESOLVED | Feb 12, 2009 | Jun 09, 2009 | |
|
GEOT-2201 | Use of CapabilitiesFilterSplitter instead of PostPreProcessFilterSplittingVisitor in ArcSDE | Gabriel Roldán | Gabriel Roldán |
|
 In Progress
|
UNRESOLVED | Dec 08, 2008 | Jun 09, 2009 | |
|
GEOT-2549 | ArcSDE JNDI DataStore support | Gabriel Roldán | Gabriel Roldán |
|
Open
|
UNRESOLVED | Jun 12, 2009 | Jun 12, 2009 | |
|
|
GEOT-2551 | Do not show raster layers as featuretypes | Gabriel Roldán | Gabriel Roldán |
|
Open
|
UNRESOLVED | Jun 12, 2009 | Jun 12, 2009 | |
|
|
GEOT-2582 | ArcSDE does never support sorting, regardless of the SortBy attributes | Gabriel Roldán | Gabriel Roldán |
|
Open
|
UNRESOLVED | Jun 30, 2009 | Jun 30, 2009 | |
|
|
GEOT-1684 | Support ArcSDE domains in the ArcSDE plugin | Saul Farber | Saul Farber |
|
Open
|
UNRESOLVED | Jan 22, 2008 | Jan 22, 2008 | |
|
|
GEOT-1421 | WFS Query with spatial operator Equals and a line geometry does not work against SDE (version 9.1) | Saul Farber | Aleda Freeman |
|
Open
|
UNRESOLVED | Aug 03, 2007 | Aug 16, 2007 | |
|
|
GEOT-1878 | plugin/arcsde test-data needs to be documented. | Saul Farber | Adrian Custer |
|
Open
|
UNRESOLVED | Jul 04, 2008 | Dec 18, 2008 | |
|
|
GEOT-2525 | Suggested patch for ArcSDE connection performance | Gabriel Roldán | Fredrik Holmqvist |
|
Open
|
UNRESOLVED | Jun 02, 2009 | Jun 02, 2009 | |
Development
ArcSDE used to have two great module maintainers looking after it: Saul Farber and Gabriel Roldan.
As per GeoTools 2.6.x Saul dropped from being a co-maintainer but still watches the mailing lists and provides great feedback. Let's thank him for the great work during the years in implementing the basis of the current ArcSDE Raster support and general module maintainance help
We have a couple short term goals:
- We have run into problems when using the ArcSDEDatastore from uDig; when performing an Edit (ie writing) a desktop client is quite willing to be drawing at the same time.
- When using a low number of connections it is quite easy to leave the DataStore without enough SeConnections to answer basic questions such as describing a FeatureType is.
Design and Research Pages
ArcSDE Installation Notes on Windows
Building a Working ArcSDE using the jsde jars
To connect to ArcSDE from java code, ESRI publishes a java library which is split across 2, 3 or 4 jars (depending on the version you use). These "java-to-ArcSDE connector jars" are here called the 'jsde' jars, so as to seperate them from our own ArcSDE module.
The ArcSDE module relies on the jsde jars for all its direct communication to ArcSDE, as indeed any java-based ArcSDE client application does. However, due to concerns about redistributing ESRI's jsde jars, geotools wanted to avoid having everyone who built gt2 download the jsde jars from the geotools maven site. This was accomplished by the use of a 'dummy' api, which is an exact mimic of the jsde api, only it doesn't actually do anything. It's simply classes which allow compilation of the ArcSDE module, without actually having or downloading the jsde jar files.
If you want to actually connect to ArcSDE using the ArcSDE module, you'll need to download the jsde jars and instruct maven to actually use them when building the ArcSDE module.
 | You have to build your module against the jsde jars if you want to use it to really access ArcSDE There have been reports of problems if you: Mostly these problems have to do with static final constants which have different values and get inlined by the compiler. There is a jira issue to track this, so if you need to do the above, check it out |
The jsde jars are actually very easily available. You can download the 9.1 jars here Just unroll the tar, zip and then tar files that you get, and extract the jsde_sdk.jar and jsde_pde.jar files.
Here's how to build the ArcSDE module with the real jsde jars:
| geotools version | sde version | instructions |
| 2.2.x | any | Modify the module pom.xml to include dependencies on com.esri:jsde_sdk:9.0,com.esri:jsde_jpe:9.0 and com.esri:jsde_concurrent:9.0. All these dependencies are commented out in the pom.xml, you just need to uncomment them and rebuild. |
| 2.3.x | any | Modify the module pom.xml to include dependencies on com.esri:jsde_sdk:9.0,com.esri:jsde_jpe:9.0 and com.esri:jsde_concurrent:9.0. All these dependencies are commented out in the pom.xml, you just need to uncomment them and rebuild. |
| 2.4.x 2.5.x 2.6.x |
9.0 | add the parameter -DhaveSDEJars=true to your maven build command. Something like this will work just fine:
$ mvn -DhaveSDEJars=true -Dmaven.test.skip clean install
Note that the jsde version 9.0 jars are publically available at maven.geotools.fr, so your maven build will just automatically download these and build everything correctly. |
| 2.4.x 2.5.x 2.6.x |
9.1 9.2 9.3 |
Add both the parameter -DhaveSDEJars=true and -Dsde.version=<version> to your maven build command. Something like this will work:
$ mvn -DhaveSDEJars=true -Dsde.version=9.2 -Dmaven.test.skip clean install
Note that no versions other than jsde 9.0 are available via a maven repository, so you'll need to inject:
|
So what do I have to type again?
To install and use the latest 9.3 jars (or whatever server you have):
- Instll the ArcSDE SDK
- Choose the option to install "arcsde developers sdk"
- It will copy the jars into C:\\ArcGIS\\ArcSD
lib by default - Open up the command line and navigate to where the jars are
- Type the following maven command:
mvn install:install-file -DgroupId=com.esri -DartifactId=jsde_sdk -Dversion=9.3 -Dfile=jsde_sdk.jar -Dpackaging=jar -DgeneratePom=true mvn install:install-file -DgroupId=com.esri -DartifactId=jpre_sdk -Dversion=9.3 -Dfile=jpe_sdk.jar -Dpackaging=jar -DgeneratePom=true
- To set up your eclipse development environment for testing - go to the root of geotools and type:
mvn eclipse:eclipse -Parcsde -Dsde.version=9.3
- You can also build on the command line:
mvn clean install -Parcsde -Dsde.version=9.3
Running the Tests Against your Own Server
TBA
Great page guys I was able to start debugging this module on trunk all without sending you email. Keep up the good work.