This section is not normally visible or accessible using the usual site navigation.
Its purpose is to automate the production of data used on LPMCC.net and to run checks. Wherever possible these tasks are automated to make them simple and foolproof so that they are run regularly, at the appropriate time, and without human error.
If a browser does not support the page scripts, its link is disabled.
Contents of this section may not be available on-line.
The index will appear here unless there is a fault in a startup function, or a duff date in the New and Updated localStorage
Annual Changes
Prepare for the New Year with changes to ...
Create the next year's gallery taking note of page file names from album_numbers.xls .
Draft a list of cycle rides using Cycle Programme to create reunions_db[] list.
After adding new reunions_db data, rewrite widge[] and weekNum() function in a NEW cyclingYYYY.js page.
Alter date in Next Cycle Route to create data for the set_next() function in cyclingYYYY.js.
Create cycling template pages for the new year gallery.
Rewrite gallery data lists of photos for Rallies and the current year gallery using admin_photoz.htm.
Write a review of the past year. Refer to admin/2021annual.txt for notes and news/admin_findauthors.htm to list contributors.
Post the Foz Annual with embargo. Use news/admin_findfoz.htm to pull Foz Spots out from the year's News updates.
Create a holding page for activity/printNN.htm until the National Rally data is available in June.
Concatenate two years of rally data in the Rally Lists (desktop and mobile). Change the Mobile Menu link in common.js to next year's Rally List.
Update redirects on short URLs www.LPMCC.net/cycle/index.htm and www.LPMCC.net/rallies/index.htm.
As soon as the New Year begins ...
The usual Statistics update.
Update home_calendar.htm to show the new year rallies saved in localStorage.
Change the target page for Alt+1 in common.js > keyNav(event).
Add old year cycle_db[ ] to cycle/cycle.js and change ../YYY/cycleYYYY.js and alert in cycle/cycle_embermiles.htm.
Add old year cycle_db[ ] to admin/dev_cycleyear.htm to create data Add the data to cycle/cycle_index.htm and change ../YYY/cycleYYYY.js and add another line of months to tmonth[ ].
Hard code the index and remove the scroll to last entry from old year blog and prepare new blog.
Modify and run dev_eurocode.htm to create replacement HTML for insertion into rally_links.htm. Create a rallyYYYY.js file with last year's complete list from rallies_past.xls.
Telephone Donington Moto Services 01509 672220 #1 and speak to Donna Page or Ian King for permission to operate National Rally Control again. Contact Marshals and ask them to put 6/7 July in their new diaries/calendars.
Run Author Feedback and send feedback to main contributors. Update admin_stats.htm>author_count[ ].
Post www.LPMCC.net/cycle/index.htm with new redirect.
Monthly - for statistics
On the last day of the month copy the created/updated/star rated figures for the month into stats.js > history_db REMmed out until tomorrow.
Website dashboard: Obtain monthly Visits and Pages from 123REG → Control Panel ↓ Web Hosting → Manage →cPanel Admin↓ Metrics → Awstats → lpmcc.net PLUS lpmcc.net(SSL) figures. Also update last month's figures.
Locales → Full list and choose month. Copy and paste the data into admin/weblog/languages.txt. Languages
creates lang_db[] for a 12 slice pie chart.
Rally List: Additions, changes, cancellations and active rallies for the previous month are counted and added to
ral_changes[ ] MUST be run before removing last month's rallies.
Jobs completed: Monthly totals of time worked and backed up files counted in job.txt. (Create a new job.txt file each year.)
Single values added to the end of mns_mth[ ] and fls_mth[ ].
Old Star Counts: Creates a snapshot of the number of ratings for pages in the menu so that pages can be counted if they are given stars in the next month.
Check Rallies: Compare, report, and remove items from rallies/standard.js > from_rallies[ ] against rallies.js > rallies_16[ ] ( needed because I cannot get web workers to work! )
On the 2nd of the month open this file in Firefox.
Download two Apache log .GZ files from the 123-reg server.
Right click and 7-Zip > Extract here. Rename as .txt files.
One at a time, copy a file to admin/weblog and rename log.txt.
Open admin_logdev03 in Firefox. It will take 20 minutes each to shorten the file.
Copy the output into short1.txt and short2.txt.
Run combine_shorts.bat to change these files into short.txt Also deletes log.txt and shrinks the original 1 & 2 files.
Open admin_logdev05 in firefox to produce top_views[...] and author_pop[...] arrays for stats.js.
REM out any top_views[...] whose URL is not in menu_db[...] except mobile/rally.htm. There must be at least ten remaining.
The author_pop[...] entries must include all 0.5% and above authors. ie it needs to go lower.
Delete the downloaded .GZ and extracted files.
Autumn Survey
LPMCC.net seeks feedback from users in October using a questionnaire and a localStorage data record.
No survey flag data. Press f5 to reload the page and show the survey if you have localStorage.
The survey does not appear until the second LPMCC.net page is opened. It does not appear on subsequent pages until LPMCC.net is revisited at least one day later. Once the survey is completed and sent in it will not appear again for at least one year. This is achieved using localStorage to flag page number, when it is visited and when the form is sent in.
the questionnaire flag.
The survey respects pop-up blocking.
Scheduled Releases
Release
Title
Stat
Item marked red are overdue. They are deleted after six days or when double-clicked.
On release date ensure that all support files are in place. eg.
Data.js > menu_db complete
RSS, Sitemap and mobile/index
Badge.js contains link
Home_map for NEW pages
Mon
Tue
Wed
Thu
Fri
Sat
Sun
New people soon to be named.
Update Content
What pages are new today?
Standard Files: sitemap.xls and mobile/index.htm are complete files. rss.xls, home_map.htm and news_index.htm are partial data files for insertion.
Validate Data Comprehensive checks of menu_db, reunions_db, badge_db & extra_db, members_db and rallies_16. Run dev_datacheck.htm as an independent diagnostic if standard pages fail to display.
Charts are now included in Statistics, imported into an iframe.
Special page data
Clean Text removes and replaces characters that do not encode properly.
Paste text into here to create web friendly version.
Removes unwanted spaces.
Replaces all quote marks by codes.
Spaces punctuation.
Capitalises I.
Converts well known initials to capitals.
Replaces foreign letters by Latin alphabet.
Add Star Ratings after copying and renaming star.eml files into admin/stars and running 1st_run.bat to rename as .txt files and create a list.
Reads data imported as text files in an iframe and therefore need to be from a server.
Rally Locations Geocodes Hans Veenendaal's Excel data for the European rallies to be plotted.
Download PDF and spreadsheet from Dropbox - Rallies to the Downloads folder.
Transfer files from Downloads to Ben\Rally Import folder.
Rename the PDF file YYYY.pdf and transfer to LPMCC.net/documents replacing the existing file.
Update standard.js with file size and date.
Delete any old XLS files in Rally Imports.
Open the new imported spreadsheet file.
Scroll to the bottom for changes and cancellations and alter rally.xls accordingly.
Change whatever is changed and add a note to the change column. Add date with ctrl: enter f2 , [change code]
Move entries that need a new GeoCode to the bottom of the list and delete the empty row.
Remove latest duplicate row and add the reference number of this and the extant entry to the duplicate list in rallies2016.js
Sort to remove blank lines.
Show hidden columns and delete them. Look for one between rally details and URL.
Start quicky.ahk (AutoHotKey on f1)
Find a space between location and rally in column D and press f1 to put a ~ (tilde) between them and move to the next row.
Continue down the whole list. Also look for apostophe s in plurals, missing - in postcodes, and ... for missing location details.
Paste whole XLS data into the text area and press CHECK button to reformat for GeoCoding.
Check there are no extra lines, errors or queries ( ??? ).
Paste the sorted file into GeoCode page.
Paste the Country tally data into rallies.js.
Start rally geocode page by clicking Geocode link.
Copy the new data and paste into Rally Geocode text area.
Include any lines of events that need re coding.
Press GEOCODE button.
Copy results back into the rallies.xls Current tab page.
Sort new data on columns L & M if there are uncoded or wrongly coded lines to bring them together.
Reprocess uncoded rallies through the Geocode page several iterations until no more can be coded.
Searcyh Google Maps for the postcode and location (columns C & D). Maybe check the given URL for location clarification.
Right click on the map and click the co-ordinates at the top of the context menu to copy them. Paste this into Lat (column H).
When all missing/incorrect data has been replaced in column H, select those clls and choose Data > Text to Columns.
Check the resulting data by pasting back into Rally Geocode and pressing the INTEGRITY button to see they are within the expected country.
Delete the error numbers from column L and M.
Remove any remaining blank lines and sort the whole page on Start, End, Postcode.
Copy the data into rallies.js > baktik[...] .
Validate Data
Correct any errors in rallies.xls AND rallies.js
Save rallies.xls.
Open data.js, change the date, query reference, and add the new total of rallies.
Open Rally List and check it is OK.
Create a new sitemap, mobile index and RSS file. Only the top of the RSS changes and delete earlier entries at the bottom of the file.
Upload all the changed files to the server.
Rally List Hard codes rally list data from current rallies.js file into format for pasting into rally_links.htm.
Author's latest page. Click this to trace the most recent report from any author.
Member message Creates CSV data and a message template appropriate for sending to people whose past membership years overlapped the person the message is about. Not available on-line
Rear Observation Creates rear_obs array for use in rearobs.js either from email forms or by manual input (from paper forms!)
New people and authors Produce data for people.js > author_data[ ] & people_data[ ]. Also checks when people become authors.
News process checklist. Keep open while doing News Update.
Pallet of preferred website colours.
Photo Processing
Copy incoming photos to the admin/photos folder, run dirn.bat then ...
Album Numbers: If creating a new album page, choose an available number from this list.
Rename: Three renaming batch files. By date of photo, by example text and thumbnails for a selected recent page.
Choose Photos: Select photos in required order and groups. Indicates aspect ratios.
Update the photo section sitemap by unremming photoSiteMap() function call in eggstra() function of data.js and then open the page for the XML to appear in the Contact Centre. Add the NEW data to the TOP of the appropriate sitemap file. Then open Image Sitemap page to remove any duplicates. Check XML syntax.
Check Thumbnails: For existance and correct 125x94 dimensions based on menu_db listing.
OpenGraph Image: Create 600x315 if there are enough thumbnails.
Incoming Documents photos and badges as they arrive and are prepared for later addition to the website. The documentation files are gallery/incoming.js and rallies/incoming.js.
Rename batch file Detects foreign characters first ! Create a list.txt of badges using dirn.bat, then run this. Paste result into renr.bat and original_names.js. Final badge names need checking.
Perspective Correction For photos taken from an angle. Reduce distortion. Images need further work in PaintShopPro. Capture image with WinKey+Shift+S.
Find existing sizes and locations of the website .GIF files.
Show and measure similar badges by comparing badge_db[ ] badge names with original_name.js > btitle[ ] data.
Badge data Use selected unused badges list from the above program to create data lines for badge_db[ ], extra_db[ ], patch_db[ ] and card_db[ ].
Code Subtypes Code cloth badges (patches), machine badges and stickers with subtypes and replace entries in patch_db[ ].
Count Subtypes Count cloth badge (patch), machine badge and sticker subtypes and find the maximum count.
Badge counts Find the latest totals from badge_db[ ], extra_db[ ], patch_db[ ] and card_db[ ].
Update Badge Sitemap Paste the result into root/sitemap_badges.xml. Then open Photos Sitemap page to remove any duplicates.
Rally Reports with no badges Writes a badge_db entry when there is a report without a badge. These must be added at the top of the badge_db letter group and NOT sorted and indexed.
Missing Rally Reports List rally reports that are NOT in BOTH menu_db AND badge_db.
Patch class promo pictures Double size promo pictures of latest and embargoed patches, machine badges etc.
Promo Badges Create a 500x200 Promo banner after adding new badges.
Thumbnails Create thumbnails from badges for rallies that do not have photos.
All Badges Hard HTML code with ALL badges with title and sender in the ALT attribute. Code is transferred to motorcycle_rally_badges.htm. Also update menu_db.
Resize badges based on the pixel size of included scales or coins. Examples of existing badges can be shown.
Badges Checks which badges are anonymous and which badges are not included in badges.js. Before running this page use the badge.bat file to create a badge.txt list of the badges in the rallies/gif folder.
Cycling Tasks
Route Plotting Geocodes polylines on a map and measures approx mileage. Used in cycling.js > fpc[ ].
Cycling Miles Creates data lines for miles from Google Keep list. Used in cycling.js > cycle_db[ ]. Adjust existing data lines for miles above minimum.
Rupert Rhymes Add rhyme to box to create Rupert banner.
WhatsApp reformat Paste in copy of WhatsApp messages to reformat into data suitable for smsnn.js file.
Review Lunches Paste ALL review emails into the reviews folder, click 1st_run.bat to rename and create list, then run this program. Output average values into pubs.js.
Pub Link Create a link to an Embers listed pub. ( automatically created for new reports )
Reduce the decimal places for Lat/Long copied from Google Map.
Regular administration
People Links Creates hard HTML coded links for everyone mentioned on LPMCC.net for home_everyone.htm and all past members mentioned for members_everyone.htm. [Update January.]
All Badges Hard HTML code with ALL badges with title and sender in the ALT attribute. Code is transferred to motorcycle_rally_badges.htm. Also update menu_db and admin_sitemap.htm. [Update February.]
Links listed with page address. Keep data in rally_links.xls and paste into external.js. Then use dev_links.htm in IE to find which links no longer work. [Check March.]
Photographs listed with page and dimensions for gallery data JS files. [Check April.]
Messages Shows the current messages contained in back_message in data.js shown in the Message Centre and the date of the cookie ID.
Page information Displays information for a page based on the page content and menu_db. Use to cross check consistency.
External services & checks
RSS Validator to check the RSS conforms to standards.
Check website security. Look for malware, blacklisting and vulnerabilities.
Convert map coordinates Convert between Latitude/Longitude & OS National Grid Reference points.
Changes to common.js
Show/hide all changes.
Date
Location
Change
New and updated
Insert this table into stats.js > history_db
Star ratings are added to history_db by hand from email count.
This table is location dependant and is only correct when regularly viewed!
