Sunday, May 15, 2016

OGR MSSQL bulk insert support added in GDAL 2.1

With the release of GDAL 2.1.0 the new bulk insert support has been added to the OGR MSSQL Spatial driver. Using the bulk insert option the upload is approx. 20 times faster comparing to the earlier driver versions, which is especially useful when uploading large data tables to MSSQL server.

The bulk insert option involved the need to implement the write support for the native SqlGeometry/SqlGeography serialization formats, which in turn eliminates the need of the server side geometry conversions from WKB and WKT causing large amount of memory pressure at the server and may cause issues like this one.

The implemented bulk insert support requires the SQL Server Native Client 10+ driver to be installed on the system. This is installed along with a SQL server setup or available from a separate package provided by Microsoft. This requirement is a bit unpleasant for the binary distribution providers, because the driver should link against the corresponding sqlncli dll. Therefore we added support to build the MSSQL spatial driver as a plugin dll (ogr_MSSQLSpatial.dll). The gdal-core msi installers (development, daily) at GISInternals have been modified to include the bulk insert enabled MSSQL driver as an optional component (not installed by default). If you enable this component, make sure that the SQL Server Native Client 11 driver is also installed on your the system, otherwise ogr2ogr will likely fail to start.



By installing this driver, the bulk insert option is enabled by default when using MSSQLSpatial as an ogr2ogr target database, however we can disable bulk insert by using the MSSQLSPATIAL_USE_BCP=FALSE config option which turns the upload to a set of "INSERT INTO" operations as usual, but that option continues to use the native geometry/geography serialization formats. We could also select the earlier WKT/WKB upload by using the UPLOAD_GEOM_FORMAT layer creation option. For more information about the config and layer creation options supported by the driver please refer to the MSSQL Spatial driver information page.

78 comments:

  1. Firstly thanks for all the great work, especially on the MS SQL.

    I've just updated to 2.0 and I'm getting a bcp error about invalid table name when I try an import that previously worked. The MapInfo layer name was "Borough Wards". If I use the -nln "Wards" option, data loads fine

    ReplyDelete
    Replies
    1. I've just fixed this one in GDAL trunk and branch 2.1 within the scope of this bug: https://trac.osgeo.org/gdal/ticket/6527

      Delete
  2. Thanks for the (extremely) quick response

    No sure where to get this ... is this in the Stable branches daily list at http://www.gisinternals.com/stable.php

    ReplyDelete
  3. Heads-up: as per Microsoft at https://msdn.microsoft.com/en-us/library/ms131321.aspx support for the SQL Server Native Client is not avauilable for SQL Server 2016.

    ReplyDelete
    Replies
    1. As far as the recent "official" ODBC drivers will support the bcp operations (without significant issues) we are good to go.

      Delete
    2. As far as the recent "official" ODBC drivers will support the bcp operations (without significant issues) we are good to go.

      Delete
  4. With the invention of smartphones, watching movies and tv shows have become so easy.
    We no longer have to wait for the shows to be telecasted on tv.
    Instead we can just download some great apps like Playbox, which provides free streaming of videos and tv shows.
    It is becoming very popular day by day and you must check it out.
    PlayBox HD Apk Download

    ReplyDelete
  5. We all live to play games on our smartphones.
    But what bugs the most is the ads those games contain and the in-app purchase option we have to go through to get the full version of those games.
    Freedom is such a unique application which frees you from these troubles. Want to know more about the Freedom app? Check out this website Download Freedom Apk Now

    ReplyDelete
  6. you can also download Freedom apk latest version
    from our site for more fun

    ReplyDelete
  7. The 2020 Masters Tournament will be watch Masters live Tournament and the first of golf's four major championships to be held in 2020.

    ReplyDelete
  8. It is even a good way for the fan to enjoy the Super Bowl 2020 Live Stream game even if you do not wish to opt for any contract cable. Not only Super Bowl live, but you can also enjoy the different sporting events on the television. You simply need a good connection along with the Sling Blue Package.

    ReplyDelete
  9. The 2020 Summer Olympics, officially known as the Games of Field hockey 2020 Summer Olympics and commonly known as Tokyo 2020 or the Recovery Olympics.

    ReplyDelete
  10. Thanks for sharing Such a valuable post and for more information. please follow the link- Virtual reality development companies

    ReplyDelete
  11. 1 World Figure Skating Championships 2020
    2 AGE AND MINIMUM TEST REQUIREMENTS.
    3 QUALIFYING:
    4 World Figure Skating Championships 2020 Live Stream Online
    5 World Figure Skating Championships 2020 Live on Smartphone
    6 World Figure Skating Championships 2020 Live on Cable
    7 World Figure Skating Championships 2020 Live without Cable
    8 World Figure Skating Championships 2020 Live on Playstation
    Click To Watch Now
    World Junior Figure Skating Championships 2020 Live Stream

    ReplyDelete
  12. Wilder vs Fury 2 Live Stream Rematch PPV Online
    Wilder vs Fury 2 Live After February 22nd there will be no more unanswered questions. I will finish what I started, and this time @Tyson_Fury will not be getting up off that canvas so quickly. I’ve proven myself time and time again and I will do it again in February.Wilder and Fury first met in December 2018, and the fight ended in a split draw. Since then, both Wilder and Fury have won two consecutive fights. Then Wilder vs Fury will face Fury in a rematch on February 22, 2020 at the MGM Grand in Las Vegas. Joshua fought in Saudi Arabia last month,

    ReplyDelete
  13. Masters Golf 2020 Live Stream Online. The 2020 Masters Tournament will be the 84th edition of the Masters Tournament and the first of golf's four major championships to be held in 2020. The Masters 2020 Live Stream. It will be held from April 9–12 at Augusta National Golf Club in Augusta, Georgia. United States.Masters 2020 Live Online.

    More: https://masters2020info.com/

    XFL 2020 Live Stream. XFL Football Game Start At 6 February. XFL 2020 Live Includes former XFL defenders, New York Guardians, St. Louis Battles, and Tampa Bay Vipers. The Dallas Renegades, Houston Roughnecks, Los Angeles Wildcats and Dragons matched the XFL West. - XFL 2020 Live Stream American Football Online with our XFL live stream guide.

    Website: https://xfl2020s.com/

    Watch UFC 249 Live Stream Online Without Cable UFC 249 Live Stream online Free 92nd UFC Fight. After more than a decade of having previously held the UFC Fight ceremonies at least at the end of February, the 92 UFC Fight will be held on February 9, 2020. And will be issued at the right time . So, if you don’t want to miss any past of the UFC 249, you must prepare for April 18, 2020.

    more:https://watchufc249.com/

     

    ReplyDelete
  14. https://ufc249fights.com/
    https://themaster2020s.com/
    https://master2020sgolf.com/

    ReplyDelete
  15. You can watch players Championship live on Sky Sports Golf. Specific times will be updated prior to the event.

    ReplyDelete
  16. Miami Masters Live Streaming https://miami--open.com/ You can catch all the tennis action in 2020 Miami, including the ATP Miami Masters live streaming.

    ReplyDelete

  17. Watch March Madness Live to see every NCAA live stream of tournament games from the First Four to the NCAA Final Four in Atlanta.

    ReplyDelete
  18. Hi there. I found your website by way of Google whilst looking for a related subject, your web site came up. It seems to be great. I have bookmarked it in my google bookmarks to come back then.

    Penn State Football Live Stream

    ReplyDelete
  19. Very nice info and straight to the point. I am not sure if this is really the best place to ask but do you people have any thoughts on where to employ some professional writers? Thanks in advance

    Notre Dame Football Live stream

    ReplyDelete
  20. If you are looking for everything about the Alabama College Football 2020 season, you are in the right place. This guide covers all there is to know about Crimson Tide. You will also get a look into the impressive records and achievements of the team.
    Alabama Football Live

    ReplyDelete
  21. Magnificent website. Plenty of helpful info here.
    I am sending it to a few buddies ans additionally sharing in delicious.
    And certainly, thanks for your effort

    Auburn Tigers Football Live stream

    ReplyDelete
  22. Hello! Would you mind if I share your blog with my zynga group? There’s a lot of people that I think would really enjoy your content. Please let me know. Thank you

    Michigan State Football Live Stream

    ReplyDelete
  23. Nebraska drives 29-17-3. In Lincoln, Nebraska drives 14-5-1. Iowa as of now has a 4 game series of wins. In a year ago's gathering, Iowa won 31-28 in Iowa City. Nebraska Football streaming will be broadcast on BTN. Kevin Kugler will do the detailed breakdown, with Matt Millen as the examination and Lisa Byington uninvolved. It can likewise be gushed on the Fox Sports App with your link or dish sign in.

    ReplyDelete
  24. Utah Utes football is one of the foremost football programs in the United States.This is a guide on how to watch Utah Football live streaming with and without cable. Get all the information you need regarding how to watch Utah College Football here.
    Utah Football Live Stream

    ReplyDelete
  25. Behind This Modern World, There Is Another World That Is Called Internet World. If You Want To Watch Kentucky Derby 2020 Online Without A Cable, You Have To Find The Online Accessible Channels.

    ReplyDelete
  26. Other stations could be streaming the game live. This means that there are different options available to you if you want to watch Master live. In the same way, if you want to watch from other parts of the world, various options are still available to you.

    ReplyDelete
  27. Masters 2020 Live is one of the four biggest national golf competition that takes place in the country. This is also the first of such big competition and it always takes place around April of every year.

    ReplyDelete
  28. Thanks for this helpful blog. Watch Clemson Tigers Football Live Stream online without cable. Get your ultimate guide to watch Clemson Tigers Football online TV Coverage, game schedule.

    ReplyDelete
  29. This is such a good post. it will help mw to make my blog wonderful that is about Georgia Football. Watch Georgia Football Live Stream online without cable. Get your ultimate guide to watch Georgia Football online TV Coverage, Date, Time, Schedule and more.

    ReplyDelete
  30. Thank you for the informative post. Watch Oklahoma Football Live Stream online without cable. Get your ultimate guide to watch Oklahoma Football Football online TV Coverage, Date, Time, Schedule and more

    ReplyDelete
  31. For those who don’t mind losing their sleep to capture all the action on the UFC 249 Live, BT Sport also broadcasts other matches in real-time through the BT Sport app and website.

    ReplyDelete
  32. WrestleMania 36 Live Stream free is an awesome thanks to enjoying the event. You ought to initially ensure the online connection and also an ideal gadget.

    ReplyDelete
  33. What a data of un-ambiguity and preserveness of precious familiarity on the topic of unexpected feelings.

    Watch NFR live stream

    ReplyDelete
  34. Your mode of explaining the whole thing in this paragraph is genuinely fastidious, every one be capable
    of easily be aware of it, Thanks a lot.

    Wrangler NFR Live stream

    ReplyDelete
  35. Howdy! Someone in my Myspace group shared this website with us so I came to look it over. I’m definitely loving the information. I’m book-marking and will be tweeting this to my followers! Terrific blog and superb style and design.

    National Finals Rodeo Live stream

    ReplyDelete
  36. Thank you for the auspicious writeup. It in fact was a amusement account it.
    Look advanced to far added agreeable from you! By the way, how could
    we communicate

    NFR Live Stream

    ReplyDelete
  37. Together at Home Concert
    Together at Home Concert Live
    Together at Home Concert Live Stream
    Watch Together at Home Concert Live Stream Online

    --------------------------------------------------------------------

    One World Together at Home
    One World Together at Home Live
    One World Together at Home Live Stream
    Watch One World Together at Home Live Stream Online

    ---------------------------------------------------------------------

    One World Together At Home Live
    One World Together At Home Live Stream
    Watch One World Together At Home Online

    ------------------------------------------------------------------------------------------------------------------------

    One World Together at Home
    One World Together at Home Live
    One World Together at Home Live Stream
    Watch One World Together at Home Live Stream Online

    ----------------------------------------------------------------------------------------

    One World Together at Home
    One World Together at Home Live
    One World Together at Home Live Stream
    Watch One World Together at Home Live Stream Online

    -----------------------------------------------------------------------------

    Together at Home Concert
    Together at Home Concert Live
    Together at Home Concert Live Stream
    Watch Together at Home Concert Live Stream Online

    ----------------------------------------------------------------------------

    Together at Home Concert
    Together at Home Concert Live
    Together at Home Concert Live Stream
    Watch Together at Home Concert Live Stream Online

    ReplyDelete
  38. This event is going to be a big PPV event. It's one of the most important UFC events in 2020. Many of us from each side are anticipating the instant of truth for four years. If you’re a real die-hard fan of UFC 249 Live, confirm you don’t miss the chance to watch this event. Reserve your option now and mark your calendar in order that you won’t miss this fantastic fight.

    UFC 249 Live
    UFC 249 Live Stream
    UFC 249 Live Stream Reddit
    Ferguson vs Gaethje Live

    ReplyDelete
  39. Kentucky Derby 2020 Live Stream Online: Kentucky Derby 2020 is about to happen: you can now catch it live on NBC! As this competition takes place on the first Saturday of May, this year it is going to occur on the 5th of September We are going to find you the ways to watch Kentucky Derby live streaming online.

    Kentucky Derby 2020
    Kentucky Derby 2020 TV Coverage
    Kentucky Derby 2020 Schedule

    ReplyDelete
  40. What’s up to every one, since I am truly keen of reading
    this weblog’s post to be updated regularly. It carries good data.

    Watch NFR live stream

    ReplyDelete
  41. I am curious to find out what blog system you happen to be using? I’m experiencing some small security issues with my latest blog and I would like to find something more safe. Do you have any recommendations

    Watch Wrangler NFR Live online

    ReplyDelete
  42. Hello there, just became aware of your blog through Google, and found that it’s truly informative. I am gonna watch out for brussels. I’ll appreciate if you continue this in future. Numerous people will be benefited from your writing. Cheers!

    National Finals Rodeo Live

    ReplyDelete
  43. This website was... how do I say it? Relevant!!
    Finally I have found something that helped me.
    Kudos!

    NFR Live Stream

    ReplyDelete
  44. This is why you must get on the scale once a few days. The results make you eat more, thinking that already you lost weight and that it is easy. I admire you for your strength. I am thinking for a diary too, but i think i will stick to the classic notebook

    Wrangler NFR Las Vegas

    ReplyDelete
  45. Very interesting stuff, I came here through google and found this post very useful, keep it up. Anyways, Get Bathurst 1000 Laps, bathurst 1000 tickets, bathurst 1000 start time, bathurst 1000 schedule, live result, performance updates and more. Thanks

    ReplyDelete
  46. Hi there, I found your blog via Google while searching for such kinda informative post and your post looks very interesting for me. Anyways, Get 24 Hours of Le Mans Stream free online TV guide, 24 Hours of Le Mans TV coverage, 24 Hours of Le Mans Tickets, 24 Hours of Le Mans TV channels, 24 Hours of Le Mans cars, 24 Hours of Le Mans live Standings, 24 Hours of Le Mans winners, live result, performance updates and more.

    ReplyDelete
  47. BENGALS PRE-DRAFT PARTY

    The party kicks off Thursday, April 23 at 7:30 p.m. ET and streams live on Bengals.com and all Bengals social media platforms. Fans can also tune-in to Local 12 in Cincinnati, WKEF in Dayton and Fox 56 in Lexington for the 30 minute party leading up to the NFL Draft at 8 p.m. Bengals Live Stream

    ReplyDelete
  48. Houston Texans Live Stream It's evident that the Houston Texans are hell-bent on concentrating on the resistance this time around in the wake of contributing such a great amount of capital on hostile weapons for Deshaun Watson — just as insurance — in the course of the last barely any seasons. As the protective line ages — J.J. Watt and Whitney Mercilus can't switch the procedure — they'll need to do a fractional revamp to guarantee they have the sprouting ability encompassing them to be effective.

    ReplyDelete
  49. Aw, this was an extremely nice post. Taking the time and actual effort to create a
    great article… but what can I say… I hesitate a lot and never seem to get nearly anything done. NFR live stream

    ReplyDelete
  50. Wonderful goods from you, man. I have understand your stuff previous to and you're just too magnificent. NFR live stream

    ReplyDelete
  51. I really like what you have acquired here, certainly like what you're
    stating and the way in which you say it. You make it enjoyable and you still care for to keep it
    wise. I can not wait to read far more from you.
    This is really a terrific website of Wrangler NFR 2020 .

    ReplyDelete
  52. Good day very nice website! Guy .. Beautiful .. Wonderful .. I'll boo?ma?k your websitfe and take the feeds al?o...I am glad to search o?t a lot of useful info?mation ri?ht here in the post, we need work out more strategies in this rega?d, thanks for sharing. Watch Wrangler NFR live stream

    ReplyDelete
  53. It's an remarkable article in favor of all the internet viewers;
    they will obtain benefit from it I am sure that NFR Live Stream Online

    ReplyDelete
  54. I blog often and I seriously appreciate your information.
    This great article has truly peaked my interest. I'm going to
    take a note of your website NFR Pass and keep checking for new details about once a week. I subscribed to your Feed as well.

    ReplyDelete
  55. Every one of the three days of the draft will be communicated on ABC, ESPN, NFL Network, ESPN Deportes and ESPN Radio. You can also visit and watch Minnesota Vikings Live Stream here on my blog

    ReplyDelete
  56. By utilizing a VPN, or virtual private system, your home's accurate area is concealed. Groups at that point can't decide whether you are inside their power outage "extend", in this way permitting you to watch whatever sports group you need. Los Angeles Chargers Live Stream

    ReplyDelete
  57. Our most loved VPN administration — and one of the most regarded — is NordVPN. I as of late changed to NordVPN, which is the most trusted VPN administration anyplace. I can vouch that they work for this precise use-case since I've done it. SO its easy to watch Atlanta Falcons Live Stream via VPN.

    ReplyDelete
  58. whatever point they play regardless of whether you're willing to pay and the second being it's not extremely portable benevolent and See Tampa Bay Buccaneers Live Stream. In any case, having said the entirety of that we emphatically prompt that you generally visit the official site in case you're down and out and might want to make up for lost time with the previous evening's down or simply need to check their record and most recent group news. In the event that you need to live stream the group, we recommend a few different techniques beneath.

    ReplyDelete
  59. The demonstration of riding the web or spilling appears through another IP is totally legitimate, and is something even the biggest organizations on the planet do constantly. Be that as it may, on the off chance that you take cover behind a VPN administration to perform criminal operations, at that point you're obviously disregarding the law - and we could never support New York Jets Live Stream

    ReplyDelete
  60. AT&T TV NOW
    Would i be able to watch the Baltimore Ravens live stream with AT&T TV NOW?
    Truly, you can watch Baltimore Ravens games on CBS, ESPN, NBC, and Fox as a feature of their PLUS bundle for $55 every month.

    ReplyDelete
  61. This website was... how do I say it? Relevant!!
    Finally I have found something that helped me.
    Kudos! NFR Live Stream Online

    ReplyDelete
  62. Your content is excellent but with pics and videos, this website
    could certainly be one of the best in its niche.
    Excellent blog! Wrangler NFR 2020

    ReplyDelete
  63. Magnificent website. Plenty of helpful info here.
    I am sending it to a few buddies ans additionally sharing in delicious.
    And certainly, thanks for your effort! Watch Wrangler NFR live stream

    ReplyDelete
  64. What’s up to every one, since I am truly keen of reading
    this weblog’s post to be updated regularly. It carries good data. NFR World Standings

    ReplyDelete
  65. Both fighters utilize grappling-muggy styles in the Octagon, considering the majority of their recent wins coming via decision. UFC 251 Live With Social Media
    will mark Usmans second title defense past winning the championship in March of last year. More UFCThe co-main business at UFC 251 is a rematch together in the midst of defending featherweight champion Alexander Volkanovski (21-1) and Max Holloway (21-5), two veteran combatants who quirk tiny commencement along in the midst of MMA fans.

    ReplyDelete
  66. Great site. Continue posting progressively instructive articles like these one. These are generally excellent articles HP printer regarding the problem solve it at home. Call our HP support Toll-Free number.
    Fix My HP Envy 7855 Printer Offline Issues
    Fix Epson Printer Error-e01 Code

    ReplyDelete