AARoads Forum

Please login or register.

Login with username, password and session length
Advanced search  

News:

Thanks to everyone for the feedback on what errors you encountered at https://www.aaroads.com/forum/index.php?topic=33904.0
Corrected several already and appreciate your patience as we work through the rest.

Author Topic: Highway Data Discussion (CHM/TravelMapping)  (Read 119587 times)

Jim

  • *
  • Offline Offline

  • Posts: 6731
  • Check out https://travelmapping.net

  • Location: Amsterdam, NY
  • Last Login: March 18, 2024, 10:01:00 PM
    • Travel and Other Pictures
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #25 on: June 21, 2015, 12:05:30 AM »

I think the quadtree should be in the neighborhood of O(n log n), though that's not the usual log2 found in many tree structures.  It was a massive improvement over the original O(n2).  Python also had a convenient set and hash table that helped make various parts far more efficient than the naive implementations.

I hope not to need anything in the site update process that's quadratic in the number of points, routes, .list entries, or anything else.  The most expensive part is still .list processing but it's not bad.  I think it should be able to handle a good number of users with a reasonable update turnaround time.
Logged
Photos I post are my own unless otherwise noted.
Signs: https://www.teresco.org/pics/signs/
Travel Mapping: https://travelmapping.net/user/?u=terescoj
Counties: http://www.mob-rule.com/user/terescoj
Twitter @JimTeresco (roads, travel, skiing, weather, sports)

english si

  • *
  • Offline Offline

  • Posts: 3637
  • Age: 37
  • Location: Buckinghamshire, England
  • Last Login: July 02, 2022, 05:33:16 AM
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #26 on: June 22, 2015, 07:26:11 AM »

I do (did?) not maintain Oregon. Looks like it was last officially left in Si's hands.
The whole state needs an overhaul - on top of the OTT shaping points issue on many routes, there's lots of points that aren't on the highway.

Plus I keep being given point requests (which I have added, even though I don't need to!) and changes.

I'd love to offload it, rather than having to deal with this demanding region (overhaul, people being on the ball about improving it), but I think I've received a couple of requests from people to maintain it, which creates an issue!
Logged

Bickendan

  • *
  • *
  • Offline Offline

  • Posts: 3011
  • Last Login: March 18, 2024, 11:19:16 PM
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #27 on: June 22, 2015, 10:59:28 AM »

I'll take Oregon back.
Logged

english si

  • *
  • Offline Offline

  • Posts: 3637
  • Age: 37
  • Location: Buckinghamshire, England
  • Last Login: July 02, 2022, 05:33:16 AM
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #28 on: June 22, 2015, 11:47:35 AM »

OK - here's my up-to-date(ish) files https://dl.dropboxusercontent.com/u/84173946/OR.zip
Logged

Bickendan

  • *
  • *
  • Offline Offline

  • Posts: 3011
  • Last Login: March 18, 2024, 11:19:16 PM
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #29 on: June 22, 2015, 11:57:40 AM »

Thanks, I'll grab it when I get home from work.
Logged

Jim

  • *
  • Offline Offline

  • Posts: 6731
  • Check out https://travelmapping.net

  • Location: Amsterdam, NY
  • Last Login: March 18, 2024, 10:01:00 PM
    • Travel and Other Pictures
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #30 on: June 24, 2015, 07:51:10 PM »

A big roadblock to getting both old (CHM veteran) and new people working on improving and expanding the highway data is the conversion to a new format.  For the most part, as mentioned before, this is nearly trivial.  My intent would be to convert all existing files, get them into their "official" location in GitHub and let people clone and fork and whatever else we decide is the way to manage the changes.  The problem is that Tim's wptedit page would still use the old .wpt file format, with the OSM URLs.  So the options as I see them:

1) We stick with the old format for now so we can keep using wptedit on Tim's site.  We risk it disappearing, and are stuck with a file format that is a bit clunky but would work.  But the process described above could happen almost immediately.

2) We copy and modify Tim's wptedit code (it's all available as far as I can tell) to use the new format.  It should be nearly trivial to do, but I'm hesitant to take his code without his permission.  I'm using some of his JS code in the map displays I developed but I had prior permission to use that code for my academic project, and a lot of it has been changed quite a bit since his last version so I feel like this is OK.  In this case, we'd be making only small modifications, using most of his code as is, with no permission of any kind granted as far as I know.

3) Someone writes a brand new highway data file editor.  This would take some time, I'm sure.
Logged
Photos I post are my own unless otherwise noted.
Signs: https://www.teresco.org/pics/signs/
Travel Mapping: https://travelmapping.net/user/?u=terescoj
Counties: http://www.mob-rule.com/user/terescoj
Twitter @JimTeresco (roads, travel, skiing, weather, sports)

sammi

  • *
  • Offline Offline

  • Posts: 1147
  • Software Developer, Sign Designer

  • Age: 26
  • Location: Toronto, ON / Baguio, Phils.
  • Last Login: December 27, 2022, 11:52:09 PM
    • SammDOT (under construction)
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #31 on: June 24, 2015, 08:07:19 PM »

3) Someone writes a brand new highway data file editor.  This would take some time, I'm sure.

What kind of functionality does this need anyway? I'd be up for it.
Logged

Jim

  • *
  • Offline Offline

  • Posts: 6731
  • Check out https://travelmapping.net

  • Location: Amsterdam, NY
  • Last Login: March 18, 2024, 10:01:00 PM
    • Travel and Other Pictures
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #32 on: June 24, 2015, 08:09:31 PM »

3) Someone writes a brand new highway data file editor.  This would take some time, I'm sure.

What kind of functionality does this need anyway? I'd be up for it.

The existing one's a good starting point:

http://cmap.m-plex.com/tools/wpteditv3/wptedit.html
Logged
Photos I post are my own unless otherwise noted.
Signs: https://www.teresco.org/pics/signs/
Travel Mapping: https://travelmapping.net/user/?u=terescoj
Counties: http://www.mob-rule.com/user/terescoj
Twitter @JimTeresco (roads, travel, skiing, weather, sports)

rickmastfan67

  • The Invisible One
  • *
  • *
  • Offline Offline

  • Posts: 3222
  • I want I-67 in PA!!!!

  • Age: 39
  • Location: Pittsburgh, Pa, USA
  • Last Login: March 16, 2024, 01:05:30 AM
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #33 on: June 24, 2015, 10:09:36 PM »

3) Someone writes a brand new highway data file editor.  This would take some time, I'm sure.

What kind of functionality does this need anyway? I'd be up for it.

The existing one's a good starting point:

I think you should have just PM'ed him the link Jim.  We don't want to overload Tim's site with people who don't really have permission to use that.

Jim

  • *
  • Offline Offline

  • Posts: 6731
  • Check out https://travelmapping.net

  • Location: Amsterdam, NY
  • Last Login: March 18, 2024, 10:01:00 PM
    • Travel and Other Pictures
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #34 on: June 24, 2015, 10:28:53 PM »

I think you should have just PM'ed him the link Jim.  We don't want to overload Tim's site with people who don't really have permission to use that.

Maybe, but it's just a single HTML file with some JS code, and if I'm seeing it right will only hit the server for the initial load.  It's all client side after the initial page load.
Logged
Photos I post are my own unless otherwise noted.
Signs: https://www.teresco.org/pics/signs/
Travel Mapping: https://travelmapping.net/user/?u=terescoj
Counties: http://www.mob-rule.com/user/terescoj
Twitter @JimTeresco (roads, travel, skiing, weather, sports)

SSOWorld

  • 'Sconsin
  • *
  • *
  • Offline Offline

  • Posts: 4227
  • Interstate <Make up your mind!>

  • Location: MAH House!
  • Last Login: March 18, 2024, 07:24:47 PM
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #35 on: June 24, 2015, 10:34:47 PM »

3) Someone writes a brand new highway data file editor.  This would take some time, I'm sure.

What kind of functionality does this need anyway? I'd be up for it.

The existing one's a good starting point:

I think you should have just PM'ed him the link Jim.  We don't want to overload Tim's site with people who don't really have permission to use that.
Use what? ;)
Logged
Scott O.

Not all who wander are lost...
Ah, the open skies, wind at my back, warm sun on my... wait, where the hell am I?!
As a matter of fact, I do own the road.
Raise your what?

Wisconsin - out-multiplexing your state since 1918.

sammi

  • *
  • Offline Offline

  • Posts: 1147
  • Software Developer, Sign Designer

  • Age: 26
  • Location: Toronto, ON / Baguio, Phils.
  • Last Login: December 27, 2022, 11:52:09 PM
    • SammDOT (under construction)
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #36 on: June 24, 2015, 10:40:42 PM »

I think you should have just PM'ed him her the link Jim.  We don't want to overload Tim's site with people who don't really have permission to use that.

It's not like that modifies any data on the server side though, just whatever the user inputs.
Logged

Highway63

  • *
  • Offline Offline

  • Posts: 154
  • Location: Iowa
  • Last Login: January 24, 2023, 06:22:05 PM
    • Iowa Highway Ends
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #37 on: June 25, 2015, 02:37:06 AM »

1) We stick with the old format for now so we can keep using wptedit on Tim's site.  We risk it disappearing, and are stuck with a file format that is a bit clunky but would work.  But the process described above could happen almost immediately.
If a new format would convert what already exists and be at least somewhat close to "write unique point name, insert weblink" then I think it could be explored. I have zero experience with GitHub though.

Quote
2) We copy and modify Tim's wptedit code (it's all available as far as I can tell) to use the new format.  It should be nearly trivial to do, but I'm hesitant to take his code without his permission.
I think starting out with it, at least, is reasonable. The worst thing that happens is that he would communicate with us about something.

mapcat

  • *
  • Offline Offline

  • Posts: 80
  • Last Login: March 17, 2024, 12:36:28 PM
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #38 on: June 25, 2015, 06:57:22 AM »

... I'm hesitant to take his code without his permission.
There was a phone number posted in the m-plex.com DNS registration info posted the other day.  Anyone considered calling it?
Logged

english si

  • *
  • Offline Offline

  • Posts: 3637
  • Age: 37
  • Location: Buckinghamshire, England
  • Last Login: July 02, 2022, 05:33:16 AM
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #39 on: June 25, 2015, 07:37:39 AM »

A big roadblock to getting both old (CHM veteran) and new people working on improving and expanding the highway data is the conversion to a new format.  For the most part, as mentioned before, this is nearly trivial.  My intent would be to convert all existing files, get them into their "official" location in GitHub and let people clone and fork and whatever else we decide is the way to manage the changes.
Except that would leave all the changes that people have made in the last 10 months behind (plus all the new systems I have that I couldn't add with Tim's "only two systems in dev at a time" and "no more Europe phase 3" rules)...
Quote
1) We stick with the old format for now so we can keep using wptedit on Tim's site.  We risk it disappearing, and are stuck with a file format that is a bit clunky but would work.  But the process described above could happen almost immediately.
this seems the easiest way. What issues are there in keeping the current format other than 'clunkiness'?
Logged

english si

  • *
  • Offline Offline

  • Posts: 3637
  • Age: 37
  • Location: Buckinghamshire, England
  • Last Login: July 02, 2022, 05:33:16 AM
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #40 on: June 25, 2015, 08:05:11 AM »

The following regions are up for grabs wrt maintanance due to Tim's absence (some of these are me making room for Tim's European systems):
- Arizona
- DC
- Delaware
- Idaho
- Kentucky
- Lousiana
- Maryland
- New Jersey
- Pennsylvania
- Quebec
Logged

Jim

  • *
  • Offline Offline

  • Posts: 6731
  • Check out https://travelmapping.net

  • Location: Amsterdam, NY
  • Last Login: March 18, 2024, 10:01:00 PM
    • Travel and Other Pictures
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #41 on: June 25, 2015, 08:07:48 AM »

A big roadblock to getting both old (CHM veteran) and new people working on improving and expanding the highway data is the conversion to a new format.  For the most part, as mentioned before, this is nearly trivial.  My intent would be to convert all existing files, get them into their "official" location in GitHub and let people clone and fork and whatever else we decide is the way to manage the changes.
Except that would leave all the changes that people have made in the last 10 months behind (plus all the new systems I have that I couldn't add with Tim's "only two systems in dev at a time" and "no more Europe phase 3" rules)...

True, but we'd easily enough be able to convert those, too.
Quote
Quote
1) We stick with the old format for now so we can keep using wptedit on Tim's site.  We risk it disappearing, and are stuck with a file format that is a bit clunky but would work.  But the process described above could happen almost immediately.
this seems the easiest way. What issues are there in keeping the current format other than 'clunkiness'?

I'd say the main arguments in favor of a new format right now are that it would be simpler and slightly easier to parse (but parsing the current wpt format is not hard), we could add support for comments (which could be added for the old format as well), the URLs are not even a current OSM format, and that if we are going to make a switch, this seems as good a time as we'll ever have to do so.  Am I missing anything?  I wouldn't mind at all if we just stick with what we have, augmented with comment support.
Logged
Photos I post are my own unless otherwise noted.
Signs: https://www.teresco.org/pics/signs/
Travel Mapping: https://travelmapping.net/user/?u=terescoj
Counties: http://www.mob-rule.com/user/terescoj
Twitter @JimTeresco (roads, travel, skiing, weather, sports)

froggie

  • *
  • Offline Offline

  • Posts: 12911
  • Location: Greensboro, VT
  • Last Login: March 18, 2024, 11:08:21 PM
    • Froggie's Place
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #42 on: June 25, 2015, 09:24:35 AM »

If nothing else, I'd think upgrading URLs to current format would be a prudent move.
Logged

Dr Frankenstein

  • *
  • Offline Offline

  • Posts: 1491
  • Canada Freezes Before Your Roads.

  • Age: 33
  • Location: LeMoyne, QC
  • Last Login: September 01, 2022, 10:24:33 PM
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #43 on: June 25, 2015, 11:28:45 AM »

I don't mind taking over Quebec, but I have no experience with creating/maintaining route files on the original CHM (I offered to do the QC provincial routes a few years ago but was denied).
Logged

Jim

  • *
  • Offline Offline

  • Posts: 6731
  • Check out https://travelmapping.net

  • Location: Amsterdam, NY
  • Last Login: March 18, 2024, 10:01:00 PM
    • Travel and Other Pictures
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #44 on: June 25, 2015, 11:47:48 AM »

If nothing else, I'd think upgrading URLs to current format would be a prudent move.

Unfortunately, that's just as hard, from the point of view of what to do about a wpt editor, as going to the simplified format we discussed a while back.
Logged
Photos I post are my own unless otherwise noted.
Signs: https://www.teresco.org/pics/signs/
Travel Mapping: https://travelmapping.net/user/?u=terescoj
Counties: http://www.mob-rule.com/user/terescoj
Twitter @JimTeresco (roads, travel, skiing, weather, sports)

yakra

  • *
  • Offline Offline

  • Posts: 1320
  • Location: Area Code 207, bub!
  • Last Login: February 13, 2024, 06:39:12 PM
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #45 on: June 25, 2015, 01:47:48 PM »

The following regions are up for grabs wrt maintanance due to Tim's absence (some of these are me making room for Tim's European systems):
- Arizona
- DC
- Delaware
- Idaho
- Kentucky
- Lousiana
- Maryland
- New Jersey
- Pennsylvania
- Quebec
I'll take LA and NJ.

QC:
ISTR that Oscar has kept his eyes on a number of changes that need to be made from the versions currently in the HB, and may have already made the edits to his local files. I'd offer to take QC (because Canada yadda yadda GISplunge), but offer first dibs to Oscar.
Carl, any objections?
Logged
"Officer, I'm always careful to drive the speed limit no matter where I am and that's what I was doin'." Said "No, you weren't," she said, "Yes, I was." He said, "Madam, I just clocked you at 22 MPH," and she said "That's the speed limit," he said "No ma'am, that's the route numbah!"  - Gary Crocker

SSOWorld

  • 'Sconsin
  • *
  • *
  • Offline Offline

  • Posts: 4227
  • Interstate <Make up your mind!>

  • Location: MAH House!
  • Last Login: March 18, 2024, 07:24:47 PM
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #46 on: June 25, 2015, 02:50:01 PM »

Does Oscar have time for all that?  :-o
Logged
Scott O.

Not all who wander are lost...
Ah, the open skies, wind at my back, warm sun on my... wait, where the hell am I?!
As a matter of fact, I do own the road.
Raise your what?

Wisconsin - out-multiplexing your state since 1918.

sammi

  • *
  • Offline Offline

  • Posts: 1147
  • Software Developer, Sign Designer

  • Age: 26
  • Location: Toronto, ON / Baguio, Phils.
  • Last Login: December 27, 2022, 11:52:09 PM
    • SammDOT (under construction)
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #47 on: June 25, 2015, 03:35:53 PM »

I have a prototype waypoint editor ready! :sombrero:

    http://travelmapping.sammdot.ca/wptedit.html

Ok so you can't really edit yet, but now when you click Export it downloads a .wpt file in my proposed new format.

    43.726756 -79.330449 WynDr WynfordDr

I'm still trying to get the importing to work. Importing works now too! It's just the actual editing part left to do. <_<
This is what a sample .wpt looks like in the new format:

    http://dl.sammdot.ca/on.on409.wpt

Just click Import and copy the contents.

(If it says the length is 0.25 mi / 0.4 km, that's just part of the prototype because I haven't written distance calculations in yet.)
« Last Edit: June 25, 2015, 07:37:35 PM by sammi »
Logged

yakra

  • *
  • Offline Offline

  • Posts: 1320
  • Location: Area Code 207, bub!
  • Last Login: February 13, 2024, 06:39:12 PM
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #48 on: June 25, 2015, 05:22:24 PM »

Does Oscar have time for all that?  :-o
Maybe, maybe not. I'll let it be his call. FWIW, when the old project went dormant he was already maintaining AK, CA, HI, YT, NT, BC, and SK.
Logged
"Officer, I'm always careful to drive the speed limit no matter where I am and that's what I was doin'." Said "No, you weren't," she said, "Yes, I was." He said, "Madam, I just clocked you at 22 MPH," and she said "That's the speed limit," he said "No ma'am, that's the route numbah!"  - Gary Crocker

rickmastfan67

  • The Invisible One
  • *
  • *
  • Offline Offline

  • Posts: 3222
  • I want I-67 in PA!!!!

  • Age: 39
  • Location: Pittsburgh, Pa, USA
  • Last Login: March 16, 2024, 01:05:30 AM
Re: Highway Data Discussion (CHM/TravelMapping)
« Reply #49 on: June 25, 2015, 08:54:11 PM »

I have a prototype waypoint editor ready! :sombrero:

    http://travelmapping.sammdot.ca/wptedit.html

Ok so you can't really edit yet, but now when you click Export it downloads a .wpt file in my proposed new format.

    43.726756 -79.330449 WynDr WynfordDr

I'm still trying to get the importing to work. Importing works now too! It's just the actual editing part left to do. <_<
This is what a sample .wpt looks like in the new format:

    http://dl.sammdot.ca/on.on409.wpt

Just click Import and copy the contents.

(If it says the length is 0.25 mi / 0.4 km, that's just part of the prototype because I haven't written distance calculations in yet.)

Looking good sammi.  However, I'm not seeing any text in the top left where it would list the waypoints.  No idea why.  Using Firefox 39 Beta.

 


Opinions expressed here on belong solely to the poster and do not represent or reflect the opinions or beliefs of AARoads, its creators and/or associates.