502 Bad Gateway / infinite xredirect on new XWiki 7.3 and new XWiki 10.4 installs

eban5 · June 16, 2018, 3:42am

I recently had an issue with a 6.0.1 Enterprise install where the best way forward was to replace the WAR file with a 7.3 WAR and just added my custom parameters to xwiki.cfg, hibernate, etc. Long story short: I thought my test XWiki 7.3 was connected to my remote test DB (hibernate.cfg.xml setting) but was actually the remote production DB, so after executing the distribution wizard on one of the subwikis I quit and left the files as they were.

I’m deploying to Tomcat 7 with Java 7 and using nginx 1.12.1 as reverse proxy. This is all on AWS Elastic Beanstalk so SSL is being terminated at the load balancer. Request comes in to port 443 and load balancer hands off to my web server unencrypted port 80, which nginx then passes on to localhost:8080 where Tomcat is running. Standard stuff from what I’ve gathered.

This setup has worked for many years here; however, now I’m getting lots of 502 Bad Gateway errors where the url to my wiki starts to generate tons of special characters when trying to redirect me to login. The URL ends up looking like this:

https://MY-WIKI.elasticbeanstalk.com/bin/login/XWiki/XWikiLogin?srid=79NNNHqI&xredirect=%2Fbin%2Flogin%2FXWiki%2FXWikiLogin%3Fsrid%3D79NNNHqI%26xredirect%3D%252Fbin%252Flogin%252FXWiki%252FXWikiLogin%253Fsrid%253D79NNNHqI%2526xredirect%253D%25252Fbin%25252Flogin%25252FXWiki%25252FXWikiLogin%25253Fsrid%25253D79NNNHqI%252526xredirect%25253D%2525252Fbin%2525252Flogin%2525252FXWiki%2525252FXWikiLogin%2525253Fsrid%2525253D79NNNHqI%25252526xredirect%2525253D%252525252Fbin%252525252Flogin%252525252FXWiki%252525252FXWikiLogin%252525253Fsrid%252525253D79NNNHqI%2525252526xredirect%252525253D%25252525252Fbin%25252525252Flogin%25252525252FXWiki%25252525252FXWikiLogin%25252525253Fsrid%25252525253D79NNNHqI%252525252526xredirect%25252525253D%2525252525252Fbin%2525252525252Flogin%2525252525252FXWiki%2525252525252FXWikiLogin%2525252525253Fsrid%2525252525253D79NNNHqI%25252525252526xredirect%2525252525253D%252525252525252Fbin%252525252525252Flogin%252525252525252FXWiki%252525252525252FXWikiLogin%252525252525253Fsrid%252525252525253D79NNNHqI%2525252525252526xredirect%252525252525253D%25252525252525252Fbin%25252525252525252Flogin%25252525252525252FXWiki%25252525252525252FXWikiLogin%25252525252525253Fsrid%25252525252525253D79NNNHqI%252525252525252526xredirect%25252525252525253D%2525252525252525252Fbin%2525252525252525252Flogin%2525252525252525252FXWiki%2525252525252525252FXWikiLogin%2525252525252525253Fsrid%2525252525252525253D79NNNHqI%25252525252525252526xredirect%2525252525252525253D%252525252525252525252Fbin%252525252525252525252Flogin%252525252525252525252FXWiki%252525252525252525252FXWikiLogin%252525252525252525253Fsrid%252525252525252525253D79NNNHqI%2525252525252525252526xredirect%252525252525252525253D%25252525252525252525252Fbin%25252525252525252525252Flogin%25252525252525252525252FXWiki%25252525252525252525252FXWikiLogin%25252525252525252525253Fsrid%25252525252525252525253D79NNNHqI%252525252525252525252526xredirect%25252525252525252525253D%2525252525252525252525252Fbin%2525252525252525252525252Flogin%2525252525252525252525252FXWiki%2525252525252525252525252FXWikiLogin%2525252525252525252525253Fsrid%2525252525252525252525253D79NNNHqI%25252525252525252525252526xredirect%2525252525252525252525253D%252525252525252525252525252Fbin%252525252525252525252525252Flogin%252525252525252525252525252FXWiki%252525252525252525252525252FXWikiLogin%252525252525252525252525253Fsrid%252525252525252525252525253D79NNNHqI%2525252525252525252525252526xredirect%252525252525252525252525253D%25252525252525252525252525252Fbin%25252525252525252525252525252Flogin%25252525252525252525252525252FXWiki%25252525252525252525252525252FXWikiLogin%25252525252525252525252525253Fsrid%25252525252525252525252525253D79NNNHqI%252525252525252525252525252526xredirect%25252525252525252525252525253D%2525252525252525252525252525252Fbin%2525252525252525252525252525252Flogin%2525252525252525252525252525252FXWiki%2525252525252525252525252525252FXWikiLogin%2525252525252525252525252525253Fsrid%2525252525252525252525252525253D79NNNHqI%25252525252525252525252525252526xredirect%2525252525252525252525252525253D%252525252525252525252525252525252Fbin%252525252525252525252525252525252Flogin%252525252525252525252525252525252FXWiki%252525252525252525252525252525252FXWikiLogin%252525252525252525252525252525253Fsrid%252525252525252525252525252525253D79NNNHqI%2525252525252525252525252525252526xredirect%252525252525252525252525252525253D%25252525252525252525252525252525252Fbin%25252525252525252525252525252525252Fview%25252525252525252525252525252525252FMain%25252525252525252525252525252525252F%25252525252525252525252525252525253Fsrid%25252525252525252525252525252525253D79NNNHqI

The errors in my Tomcat are just from a plugin:

2018-06-15 23:23:57,328 [XWiki Scheduler initialization] ERROR c.x.x.p.s.SchedulerPlugin      - Failed to restore job with in document [xwiki:Scheduler.WatchListDailyNotifier] and wiki [xwiki]
    com.xpn.xwiki.plugin.scheduler.SchedulerPluginException: Error number 90004 in 5: Exception in plugin [com.xpn.xwiki.plugin.scheduler.SchedulerPlugin]: Error while scheduling job WatchList daily notifier
    	at com.xpn.xwiki.plugin.scheduler.SchedulerPlugin.scheduleJob(SchedulerPlugin.java:415) [xwiki-platform-scheduler-api-7.3.jar:na]
    	at com.xpn.xwiki.plugin.scheduler.SchedulerPlugin.register(SchedulerPlugin.java:317) [xwiki-platform-scheduler-api-7.3.jar:na]
    	at com.xpn.xwiki.plugin.scheduler.SchedulerPlugin.register(SchedulerPlugin.java:310) [xwiki-platform-scheduler-api-7.3.jar:na]
    	at com.xpn.xwiki.plugin.scheduler.SchedulerPlugin.restoreExistingJobs(SchedulerPlugin.java:295) [xwiki-platform-scheduler-api-7.3.jar:na]
    	at com.xpn.xwiki.plugin.scheduler.SchedulerPlugin.initAsync(SchedulerPlugin.java:164) [xwiki-platform-scheduler-api-7.3.jar:na]
    	at com.xpn.xwiki.plugin.scheduler.SchedulerPlugin.access$000(SchedulerPlugin.java:76) [xwiki-platform-scheduler-api-7.3.jar:na]
    	at com.xpn.xwiki.plugin.scheduler.SchedulerPlugin$1.run(SchedulerPlugin.java:123) [xwiki-platform-scheduler-api-7.3.jar:na]
    	at org.xwiki.context.concurrent.ExecutionContextRunnable.run(ExecutionContextRunnable.java:70) [xwiki-commons-context-7.3.jar:na]
    	at java.lang.Thread.run(Thread.java:748) [na:1.7.0_181]
    Caused by: org.quartz.SchedulerException: Based on configured schedule, the given trigger 'DEFAULT.xwiki:Scheduler.WatchListDailyNotifier_0' will never fire.
    	at org.quartz.core.QuartzScheduler.scheduleJob(QuartzScheduler.java:928) ~[quartz-2.2.1.jar:na]
    	at org.quartz.impl.StdScheduler.scheduleJob(StdScheduler.java:258) ~[quartz-2.2.1.jar:na]
    	at com.xpn.xwiki.plugin.scheduler.SchedulerPlugin.scheduleJob(SchedulerPlugin.java:399) [xwiki-platform-scheduler-api-7.3.jar:na]
    	... 8 common frames omitted
    2018-06-15 23:24:00,218 [XWiki initialization] WARN  iComponentManagerEventListener - Failed to register the wiki component located in the document [xwiki:AnniversaryInvitees.WebHome]: WikiComponentException: Registering UI extensions at wiki level requires wiki administration rights
    2018-06-15 23:24:01,946 [XWiki Solr index job thread] INFO  o.x.s.s.i.j.IndexerJob         - Starting job of type [solr.indexer] with identifier [[solr, indexer]]
    2018-06-15 23:24:21,508 [XWiki Solr index job thread] INFO  o.x.s.s.i.j.IndexerJob         - 1 documents added, 1 deleted and 0 updated during the synchronization of the Solr index.
    2018-06-15 23:24:21,509 [XWiki Solr index job thread] INFO  o.x.s.s.i.j.IndexerJob         - Finished job of type [solr.indexer] with identifier [[solr, indexer]]

And then nothing else besides this and my Tomcat logs don’t move at all:

2018-06-15 23:24:01,946 [XWiki Solr index job thread] INFO  o.x.s.s.i.j.IndexerJob         - Starting job of type [solr.indexer] with identifier [[solr, indexer]]
2018-06-15 23:24:21,508 [XWiki Solr index job thread] INFO  o.x.s.s.i.j.IndexerJob         - 1 documents added, 1 deleted and 0 updated during the synchronization of the Solr index.
2018-06-15 23:24:21,509 [XWiki Solr index job thread] INFO  o.x.s.s.i.j.IndexerJob         - Finished job of type [solr.indexer] with identifier [[solr, indexer]]

nginx tells me pretty much what I already know with the giant URL and

*8 upstream sent too big header while reading response header from upstream

The configuration file checks out nginx -t with an OK after checking syntax and that it is correct.

I’m convinced that I’m forgetting something at the XWiki / application level. I can see the favicon that is in my webapp (which is deployed to /var/lib/tomcat7/webapps/ROOT). Is there anything that I haven’t thought of for the redirecting settings in web.xml?

vmassol · June 18, 2018, 7:29am

Hi, would be good if you could update to a supported version of XWiki, i.e. 9.11.6 or 10.4 (or 10.5RC1). See http://www.xwiki.org/xwiki/bin/view/Main/Support#HSupportedVersions

“Failed to register the wiki component located in the document [xwiki:AnniversaryInvitees.WebHome]: WikiComponentException: Registering UI extensions at wiki level requires wiki administration rights”

This page is using a wiki level UIX and thus needs to be saved by a user having Admin rights.

eban5 · June 18, 2018, 12:40pm

Thanks for the reply, Vincent. Getting to more current releases is certainly our plan; however, I was just being a bit cautious about jumping several major versions right away. Since we are still on v6.0.1, the concept of Spaces/Pages and Parent/Child is something many here have gotten used to and I’m still testing how Nested Pages affects some custom components we made.
I’ll give it a shot in a test environment. Maybe that will resolve the strange URLs on redirect to XWiki/XWikiLogin.

eban5 · June 18, 2018, 5:09pm

@vmassol I upgraded to 10.4 and got as far as the Distribution Wizard “XWiki Initializing (x%)” but then same result - Bad Gateway from nginx 1.12.1. It’s strange because this has happened to us on both Apache HTTPD (2.2 and 2.4) as well as Nginx but restarts of both Tomcat and Nginx (or whatever) usually let us then access the wiki normally. I’m looking around and having trouble finding others with similar Bad Gateway 502 errors with XWiki. Just as a reminder, I’m using nginx as a reverse-proxy for Tomcat (only http, SSL termination point is before my web server on the AWS load balancer so no https in nginx or tomcat conf). I am revisiting the settings found here on this XWiki doc page but finding I already have all of these settings (since we’ve been successfully using XWiki over HTTPS for a few years).

For reference, my Tomcat catalina.out is below as well as my nginx error.log.

OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=512m; support was removed in 8.0
18-Jun-2018 13:00:20.497 WARNING [main] org.apache.tomcat.util.digester.SetPropertiesRule.begin [SetPropertiesRule]{Server/Service/Engine/Host/Valve} Setting property 'remoteIpProxiesHeader' to 'x-forwarded-by' did not find a matching property.
18-Jun-2018 13:00:20.504 INFO [main] org.apache.catalina.core.AprLifecycleListener.lifecycleEvent The APR based Apache Tomcat Native library which allows optimal performance in production environments was not found on the java.library.path: /usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
18-Jun-2018 13:00:20.689 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["http-nio-8080"]
18-Jun-2018 13:00:20.728 INFO [main] org.apache.tomcat.util.net.NioSelectorPool.getSharedSelector Using a shared selector for servlet write/read
18-Jun-2018 13:00:20.732 INFO [main] org.apache.coyote.AbstractProtocol.init Initializing ProtocolHandler ["ajp-nio-8009"]
18-Jun-2018 13:00:20.736 INFO [main] org.apache.tomcat.util.net.NioSelectorPool.getSharedSelector Using a shared selector for servlet write/read
18-Jun-2018 13:00:20.738 INFO [main] org.apache.catalina.startup.Catalina.load Initialization processed in 978 ms
18-Jun-2018 13:00:20.790 INFO [main] org.apache.catalina.core.StandardService.startInternal Starting service Catalina
18-Jun-2018 13:00:20.791 INFO [main] org.apache.catalina.core.StandardEngine.startInternal Starting Servlet Engine: Apache Tomcat/8.0.50
18-Jun-2018 13:00:20.809 INFO [localhost-startStop-1] org.apache.catalina.startup.HostConfig.deployDirectory Deploying web application directory /var/lib/tomcat8/webapps/ROOT
18-Jun-2018 13:00:51.430 INFO [localhost-startStop-1] org.apache.jasper.servlet.TldScanner.scanJars At least one JAR was scanned for TLDs yet contained no TLDs. Enable debug logging for this logger for a complete list of JARs that were scanned but no TLDs were found in them. Skipping unneeded JARs during scanning can improve startup time and JSP compilation time.
2018-06-18 13:00:56,381 [localhost-startStop-1] INFO  iPropertiesConfigurationSource - loading xwiki.properties from file:/var/lib/tomcat8/webapps/ROOT/WEB-INF/xwiki.properties
2018-06-18 13:00:56,696 [localhost-startStop-1] INFO  o.x.e.i.ServletEnvironment     - Using permanent directory [/var/local/scd]
2018-06-18 13:00:59,408 [localhost-startStop-1] WARN  ltInstalledExtensionRepository - Invalid extension [org.xwiki.enterprise:xwiki-enterprise-ui-wiki/6.0.1] on namespace [wiki:usmcc4] (InvalidExtensionException: No compatible extension is installed for dependency [org.xwiki.platform:xwiki-platform-chart-plugin-6.0.1])
2018-06-18 13:00:59,410 [localhost-startStop-1] WARN  ltInstalledExtensionRepository - Invalid extension [org.xwiki.contrib:xwiki-multipagepdfexport-application-spaceexport/1.0] on namespace [wiki:interns] (InvalidExtensionException: No compatible extension is installed for dependency [org.xwiki.contrib:xwiki-multipagepdfexport-1.0])
2018-06-18 13:01:04,171 [localhost-startStop-1] INFO  o.x.s.s.i.EmbeddedSolrInstance - Starting embedded Solr server...
2018-06-18 13:01:04,175 [localhost-startStop-1] INFO  o.x.s.s.i.EmbeddedSolrInstance - Using Solr home directory: [/var/local/scd/solr]
2018-06-18 13:01:07,618 [coreLoadExecutor-6-thread-1] WARN  o.a.s.c.SolrResourceLoader     - Solr loaded a deprecated plugin/analysis class [solr.SynonymFilterFactory]. Please consult documentation how to replace it accordingly.
2018-06-18 13:01:11,506 [localhost-startStop-1] INFO  o.x.s.s.i.EmbeddedSolrInstance - Started embedded Solr server.
18-Jun-2018 13:01:11.547 INFO [localhost-startStop-1] org.artofsolving.jodconverter.office.ProcessPoolOfficeManager.<init> ProcessManager implementation is LinuxProcessManager
2018-06-18 13:01:11,611 [localhost-startStop-1] ERROR .OfficeServerLifecycleListener - Error while connecting / starting the office server.
org.xwiki.officeimporter.server.OfficeServerException: Error while connecting / starting the office server.
	at org.xwiki.officeimporter.internal.server.DefaultOfficeServer.start(DefaultOfficeServer.java:187)
	at org.xwiki.officeimporter.internal.server.OfficeServerLifecycleListener.startOfficeServer(OfficeServerLifecycleListener.java:98)
	at org.xwiki.officeimporter.internal.server.OfficeServerLifecycleListener.onEvent(OfficeServerLifecycleListener.java:85)
	at org.xwiki.observation.internal.DefaultObservationManager.notify(DefaultObservationManager.java:304)
	at org.xwiki.observation.internal.DefaultObservationManager.notify(DefaultObservationManager.java:269)
	at org.xwiki.observation.internal.DefaultObservationManager.notify(DefaultObservationManager.java:321)
	at org.xwiki.container.servlet.XWikiServletContextListener.contextInitialized(XWikiServletContextListener.java:126)
	at org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:4861)
	at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5322)
	at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:145)
	at org.apache.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:753)
	at org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java:729)
	at org.apache.catalina.core.StandardHost.addChild(StandardHost.java:717)
	at org.apache.catalina.startup.HostConfig.deployDirectory(HostConfig.java:1126)
	at org.apache.catalina.startup.HostConfig$DeployDirectory.run(HostConfig.java:1868)
	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.artofsolving.jodconverter.office.OfficeException: failed to start and connect
	at org.artofsolving.jodconverter.office.ManagedOfficeProcess.startAndWait(ManagedOfficeProcess.java:66)
	at org.artofsolving.jodconverter.office.PooledOfficeManager.start(PooledOfficeManager.java:114)
	at org.artofsolving.jodconverter.office.ProcessPoolOfficeManager.start(ProcessPoolOfficeManager.java:61)
	at org.xwiki.officeimporter.internal.server.DefaultOfficeServer.start(DefaultOfficeServer.java:182)
	... 19 common frames omitted
Caused by: java.util.concurrent.ExecutionException: org.artofsolving.jodconverter.office.OfficeException: could not establish connection
	at java.util.concurrent.FutureTask.report(FutureTask.java:122)
	at java.util.concurrent.FutureTask.get(FutureTask.java:192)
	at org.artofsolving.jodconverter.office.ManagedOfficeProcess.startAndWait(ManagedOfficeProcess.java:64)
	... 22 common frames omitted
Caused by: org.artofsolving.jodconverter.office.OfficeException: could not establish connection
	at org.artofsolving.jodconverter.office.ManagedOfficeProcess.doStartProcessAndConnect(ManagedOfficeProcess.java:162)
	at org.artofsolving.jodconverter.office.ManagedOfficeProcess.access$000(ManagedOfficeProcess.java:25)
	at org.artofsolving.jodconverter.office.ManagedOfficeProcess$1.run(ManagedOfficeProcess.java:60)
	... 5 common frames omitted
Caused by: java.lang.IllegalStateException: a process with acceptString 'socket,host=127.0.0.1,port=8100' is already running; pid 5038
	at org.artofsolving.jodconverter.office.OfficeProcess.start(OfficeProcess.java:72)
	at org.artofsolving.jodconverter.office.OfficeProcess.start(OfficeProcess.java:64)
	at org.artofsolving.jodconverter.office.ManagedOfficeProcess.doStartProcessAndConnect(ManagedOfficeProcess.java:134)
	... 7 common frames omitted
18-Jun-2018 13:01:14.373 INFO [localhost-startStop-1] org.apache.catalina.startup.HostConfig.deployDirectory Deployment of web application directory /var/lib/tomcat8/webapps/ROOT has finished in 53,564 ms
18-Jun-2018 13:01:14.377 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["http-nio-8080"]
18-Jun-2018 13:01:14.385 INFO [main] org.apache.coyote.AbstractProtocol.start Starting ProtocolHandler ["ajp-nio-8009"]
18-Jun-2018 13:01:14.388 INFO [main] org.apache.catalina.startup.Catalina.start Server startup in 53649 ms
^C
[root@ip-10-180-110-85 nginx]# service nginx restart
Stopping nginx:                                            [  OK  ]
Starting nginx:                                            [  OK  ]
[root@ip-10-180-110-85 nginx]# tail -f /var/log/tomcat8/catalina.out
2018-06-18 13:01:55,445 [XWiki initialization] INFO  .HibernateDataMigrationManager - No data migration to apply for wiki [gccsj] currently in version [1004001]
2018-06-18 13:01:55,445 [XWiki initialization] INFO  .HibernateDataMigrationManager - Checking Hibernate mapping and updating schema if needed for wiki [gccsj]
2018-06-18 13:01:55,837 [XWiki initialization] INFO  .HibernateDataMigrationManager - No data migration to apply for wiki [gccsjstakeholders] currently in version [1004001]
2018-06-18 13:01:55,837 [XWiki initialization] INFO  .HibernateDataMigrationManager - Checking Hibernate mapping and updating schema if needed for wiki [gccsjstakeholders]
2018-06-18 13:01:56,205 [XWiki initialization] INFO  .HibernateDataMigrationManager - No data migration to apply for wiki [usmcc4] currently in version [1004001]
2018-06-18 13:01:56,206 [XWiki initialization] INFO  .HibernateDataMigrationManager - Checking Hibernate mapping and updating schema if needed for wiki [usmcc4]
2018-06-18 13:01:56,598 [XWiki initialization] INFO  .HibernateDataMigrationManager - No data migration to apply for wiki [usmcmra] currently in version [1004001]
2018-06-18 13:01:56,599 [XWiki initialization] INFO  .HibernateDataMigrationManager - Checking Hibernate mapping and updating schema if needed for wiki [usmcmra]
2018-06-18 13:01:56,969 [XWiki initialization] INFO  .HibernateDataMigrationManager - No data migration to apply for wiki [opportunities] currently in version [1004001]
2018-06-18 13:01:56,969 [XWiki initialization] INFO  .HibernateDataMigrationManager - Checking Hibernate mapping and updating schema if needed for wiki [opportunities]
2018-06-18 13:01:57,319 [XWiki initialization] INFO  .HibernateDataMigrationManager - No data migration to apply for wiki [bp] currently in version [1004001]
2018-06-18 13:01:57,319 [XWiki initialization] INFO  .HibernateDataMigrationManager - Checking Hibernate mapping and updating schema if needed for wiki [bp]
2018-06-18 13:01:57,673 [XWiki initialization] INFO  .HibernateDataMigrationManager - No data migration to apply for wiki [jopesstakeholders] currently in version [1004001]
2018-06-18 13:01:57,673 [XWiki initialization] INFO  .HibernateDataMigrationManager - Checking Hibernate mapping and updating schema if needed for wiki [jopesstakeholders]
2018-06-18 13:01:58,047 [XWiki initialization] INFO  .HibernateDataMigrationManager - No data migration to apply for wiki [jopes] currently in version [1004001]
2018-06-18 13:01:58,047 [XWiki initialization] INFO  .HibernateDataMigrationManager - Checking Hibernate mapping and updating schema if needed for wiki [jopes]
2018-06-18 13:01:58,376 [XWiki initialization] INFO  .HibernateDataMigrationManager - No data migration to apply for wiki [operations] currently in version [1004001]
2018-06-18 13:01:58,376 [XWiki initialization] INFO  .HibernateDataMigrationManager - Checking Hibernate mapping and updating schema if needed for wiki [operations]
2018-06-18 13:01:58,695 [XWiki initialization] INFO  .HibernateDataMigrationManager - No data migration to apply for wiki [gccsjfsse] currently in version [1004001]
2018-06-18 13:01:58,696 [XWiki initialization] INFO  .HibernateDataMigrationManager - Checking Hibernate mapping and updating schema if needed for wiki [gccsjfsse]
2018-06-18 13:01:59,057 [XWiki initialization] INFO  .HibernateDataMigrationManager - No data migration to apply for wiki [interns] currently in version [1004001]
2018-06-18 13:01:59,057 [XWiki initialization] INFO  .HibernateDataMigrationManager - Checking Hibernate mapping and updating schema if needed for wiki [interns]
2018-06-18 13:01:59,427 [XWiki initialization] INFO  .HibernateDataMigrationManager - No data migration to apply for wiki [partners] currently in version [1004001]
2018-06-18 13:01:59,427 [XWiki initialization] INFO  .HibernateDataMigrationManager - Checking Hibernate mapping and updating schema if needed for wiki [partners]
2018-06-18 13:01:59,768 [XWiki initialization] INFO  .HibernateDataMigrationManager - No data migration to apply for wiki [shahshah] currently in version [1004001]
2018-06-18 13:01:59,769 [XWiki initialization] INFO  .HibernateDataMigrationManager - Checking Hibernate mapping and updating schema if needed for wiki [shahshah]
2018-06-18 13:02:13,322 [XWiki Scheduler initialization] ERROR c.x.x.p.s.SchedulerPlugin      - Failed to restore job with in document [xwiki:Scheduler.WatchListDailyNotifier] and wiki [xwiki]
com.xpn.xwiki.plugin.scheduler.SchedulerPluginException: Error number 90004 in 5: Exception in plugin [com.xpn.xwiki.plugin.scheduler.SchedulerPlugin]: Error while scheduling job WatchList daily notifier
	at com.xpn.xwiki.plugin.scheduler.SchedulerPlugin.scheduleJob(SchedulerPlugin.java:424)
	at com.xpn.xwiki.plugin.scheduler.SchedulerPlugin.register(SchedulerPlugin.java:317)
	at com.xpn.xwiki.plugin.scheduler.SchedulerPlugin.register(SchedulerPlugin.java:310)
	at com.xpn.xwiki.plugin.scheduler.SchedulerPlugin.restoreExistingJobs(SchedulerPlugin.java:295)
	at com.xpn.xwiki.plugin.scheduler.SchedulerPlugin.initAsync(SchedulerPlugin.java:164)
	at com.xpn.xwiki.plugin.scheduler.SchedulerPlugin.access$000(SchedulerPlugin.java:76)
	at com.xpn.xwiki.plugin.scheduler.SchedulerPlugin$1.run(SchedulerPlugin.java:123)
	at org.xwiki.context.concurrent.ExecutionContextRunnable.run(ExecutionContextRunnable.java:70)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.quartz.SchedulerException: Based on configured schedule, the given trigger 'DEFAULT.xwiki:Scheduler.WatchListDailyNotifier_0' will never fire.
	at org.quartz.core.QuartzScheduler.scheduleJob(QuartzScheduler.java:928)
	at org.quartz.impl.StdScheduler.scheduleJob(StdScheduler.java:258)
	at com.xpn.xwiki.plugin.scheduler.SchedulerPlugin.scheduleJob(SchedulerPlugin.java:407)
	... 8 common frames omitted
2018-06-18 13:02:15,458 [solr/indexer job group daemon thread - org.xwiki.search.solr.internal.job.IndexerJob@638db8a5] INFO  o.x.s.s.i.j.IndexerJob         - Starting job of type [solr.indexer] with identifier [[solr, indexer]]
2018-06-18 13:02:16,989 [XWiki initialization] WARN  onentManagerEventListenerProxy - Unable to register the component associated to [Object xwiki:AnniversaryInvitees.WebHome^XWiki.UIExtensionClass[0]]: WikiComponentException: Registering UI extensions at wiki level requires wiki administration rights
2018-06-18 13:02:17,578 [XWiki initialization] WARN  onentManagerEventListenerProxy - Unable to register the component associated to [Object xwiki:Glossary.WebHome^XWiki.UIExtensionClass[0]]: WikiComponentException: Registering UI extensions at wiki level requires wiki administration rights
2018-06-18 13:02:18,397 [XWiki initialization] WARN  onentManagerEventListenerProxy - Unable to register the component associated to [Object xwiki:WikiCode.UserWikisIsOwnerWidget^Panels.PanelClass[0]]: ComponentLookupException: Can't find descriptor for the component with type [interface org.xwiki.rendering.parser.Parser] and hint [xwiki/1.0]
2018-06-18 13:02:18,425 [XWiki initialization] WARN  onentManagerEventListenerProxy - Unable to register the component associated to [Object xwiki:WikiCode.UserWikisIsUserWidget^Panels.PanelClass[0]]: ComponentLookupException: Can't find descriptor for the component with type [interface org.xwiki.rendering.parser.Parser] and hint [xwiki/1.0]
2018-06-18 13:02:18,459 [XWiki initialization] WARN  onentManagerEventListenerProxy - Unable to register the component associated to [Object xwiki:WikiCode.LastCreatedWikisWidget^Panels.PanelClass[0]]: ComponentLookupException: Can't find descriptor for the component with type [interface org.xwiki.rendering.parser.Parser] and hint [xwiki/1.0]
2018-06-18 13:02:18,808 [XWiki initialization] WARN  onentManagerEventListenerProxy - Unable to register the component associated to [Object xwiki:WikiCode.MyLastWikiModificationsWidget^Panels.PanelClass[0]]: ComponentLookupException: Can't find descriptor for the component with type [interface org.xwiki.rendering.parser.Parser] and hint [xwiki/1.0]
2018-06-18 13:02:18,880 [XWiki initialization] WARN  onentManagerEventListenerProxy - Unable to register the component associated to [Object xwiki:Mockups.AddMockupPanel^Panels.PanelClass[0]]: ComponentLookupException: Can't find descriptor for the component with type [interface org.xwiki.rendering.parser.Parser] and hint [xwiki/1.0]
2018-06-18 13:02:18,908 [XWiki initialization] WARN  onentManagerEventListenerProxy - Unable to register the component associated to [Object xwiki:WikiCode.LastWikiModificationsWidget^Panels.PanelClass[0]]: ComponentLookupException: Can't find descriptor for the component with type [interface org.xwiki.rendering.parser.Parser] and hint [xwiki/1.0]
2018-06-18 13:02:19,174 [XWiki initialization] WARN  onentManagerEventListenerProxy - Unable to register the component associated to [Object xwiki:WikiCode.UserWikisIsAdminWidget^Panels.PanelClass[0]]: ComponentLookupException: Can't find descriptor for the component with type [interface org.xwiki.rendering.parser.Parser] and hint [xwiki/1.0]
2018-06-18 13:02:35,563 [solr/indexer job group daemon thread - org.xwiki.search.solr.internal.job.IndexerJob@638db8a5] INFO  o.x.s.s.i.j.IndexerJob         - 11562 documents added, 9 deleted and 0 updated during the synchronization of the Solr index.
2018-06-18 13:02:35,564 [solr/indexer job group daemon thread - org.xwiki.search.solr.internal.job.IndexerJob@638db8a5] INFO  o.x.s.s.i.j.IndexerJob         - Finished job of type [solr.indexer] with identifier [[solr, indexer]]

Nginx Error.log

2018/06/18 17:02:22 [error] 1503#0: *4 upstream sent too big header while reading response header from upstream, client: 10.235.39.25, server: *.elasticbeanstalk.com, request: "GET /bin/login/XWiki/XWikiLogin?srid=m5UxydNd&xredirect=%2Fbin%2Fview%2Fbin%2Flogin%2FXWiki%2FXWikiLogin%2F%3Fsrid%3Dm5UxydNd%26xredirect%3D%252Fbin%252Fview%252Fbin%252Flogin%252FXWiki%252FXWikiLogin%252F%253Fsrid%253Dm5UxydNd%2526xredirect%253D%25252Fbin%25252Fview%25252Fbin%25252Flogin%25252FXWiki%25252FXWikiLogin%25252F%25253Fsrid%25253Dm5UxydNd%252526xredirect%25253D%2525252Fbin%2525252Fview%2525252Fbin%2525252Flogin%2525252FXWiki%2525252FXWikiLogin%2525252F%2525253Fsrid%2525253Dm5UxydNd%25252526xredirect%2525253D%252525252Fbin%252525252Fview%252525252Fbin%252525252Flogin%252525252FXWiki%252525252FXWikiLogin%252525252F%252525253Fsrid%252525253Dm5UxydNd%2525252526xredirect%252525253D%25252525252Fbin%25252525252Fview%25252525252Fbin%25252525252Flogin%25252525252FXWiki%25252525252FXWikiLogin%25252525252F%25252525253Fsrid%25252525253Dm5UxydNd%252525252526xredirect%25252525253D%2525252525252Fbin%2525252525252Fview%2525252525252Fbin%2525252525252Flogin%2525252525252FXWiki%2525252525252FXWikiLogin%2525252525252F%2525252525253Fsrid%2525252525253Dm5UxydNd%25252525252526xredirect%2525252525253D%252525252525252Fbin%252525252525252Fview%252525252525252Fbin%252525252525252Flogin%252525252525252FXWiki%252525252525252FXWikiLogin%252525252525252F%252525252525253Fsrid%252525252525253Dm5UxydNd%2525252525252526xredirect%252525252525253D%25252525252525252Fbin%25252525252525252Fview%25252525252525252Fbin%25252525252525252Flogin%25252525252525252FXWiki%25252525252525252FXWikiLogin%25252525252525252F%25252525252525253Fsrid%25252525252525253Dm5UxydNd%252525252525252526xredirect%25252525252525253D%2525252525252525252Fbin%2525252525252525252Fview%2525252525252525252Fbin%2525252525252525252Flogin%2525252525252525252FXWiki%2525252525252525252FXWikiLogin%2525252525252525252F%2525252525252525253Fsrid%2525252525252525253Dm5UxydNd%25252525252525252526xredirect%2525
2018/06/18 17:03:11 [error] 1503#0: *76 upstream sent too big header while reading response header from upstream, client: 10.235.39.25, server: *.elasticbeanstalk.com, request: "GET /bin/login/XWiki/XWikiLogin?srid=nEMVKRUg&xredirect=%2Fbin%2Fview%2Fbin%2Flogin%2FXWiki%2FXWikiLogin%2F%3Fsrid%3DnEMVKRUg%26xredirect%3D%252Fbin%252Fview%252Fbin%252Flogin%252FXWiki%252FXWikiLogin%252F%253Fsrid%253DnEMVKRUg%2526xredirect%253D%25252Fbin%25252Fview%25252Fbin%25252Flogin%25252FXWiki%25252FXWikiLogin%25252F%25253Fsrid%25253DnEMVKRUg%252526xredirect%25253D%2525252Fbin%2525252Fview%2525252Fbin%2525252Flogin%2525252FXWiki%2525252FXWikiLogin%2525252F%2525253Fsrid%2525253DnEMVKRUg%25252526xredirect%2525253D%252525252Fbin%252525252Fview%252525252Fbin%252525252Flogin%252525252FXWiki%252525252FXWikiLogin%252525252F%252525253Fsrid%252525253DnEMVKRUg%2525252526xredirect%252525253D%25252525252Fbin%25252525252Fview%25252525252Fbin%25252525252Flogin%25252525252FXWiki%25252525252FXWikiLogin%25252525252F%25252525253Fsrid%25252525253DnEMVKRUg%252525252526xredirect%25252525253D%2525252525252Fbin%2525252525252Fview%2525252525252Fbin%2525252525252Flogin%2525252525252FXWiki%2525252525252FXWikiLogin%2525252525252F%2525252525253Fsrid%2525252525253DnEMVKRUg%25252525252526xredirect%2525252525253D%252525252525252Fbin%252525252525252Fview%252525252525252Fbin%252525252525252Flogin%252525252525252FXWiki%252525252525252FXWikiLogin%252525252525252F%252525252525253Fsrid%252525252525253DnEMVKRUg%2525252525252526xredirect%252525252525253D%25252525252525252Fbin%25252525252525252Fview%25252525252525252Fbin%25252525252525252Flogin%25252525252525252FXWiki%25252525252525252FXWikiLogin%25252525252525252F%25252525252525253Fsrid%25252525252525253DnEMVKRUg%252525252525252526xredirect%25252525252525253D%2525252525252525252Fbin%2525252525252525252Fview%2525252525252525252Fbin%2525252525252525252Flogin%2525252525252525252FXWiki%2525252525252525252FXWikiLogin%2525252525252525252F%2525252525252525253Fsrid%2525252525252525253DnEMVKRUg%25252525252525252526xredirect%252

eban5 · June 18, 2018, 9:27pm

Some more information on what I’m seeing. It looks like the xredirect query parameter value is being filled with /bin/view/bin/login/XWiki/XWikiLogin over and over again, each time with more malformed special character encodings:

&xredirect=%2Fbin%2Fview%2Fbin%2Flogin%2FXWiki%2FXWikiLogin%2F%3Fsrid%3Dm5UxydNd%26xredirect%3D%252Fbin%252Fview%252Fbin%252Flogin%252FXWiki%252FXWikiLogin%252F%253Fsrid%253Dm5UxydNd%2526xredirect%253D%25252Fbin%25252Fview%25252Fbin%25252Flogin%25252FXWiki%25252FXWi

…on and on and on until nginx gives up. That looks like a malformed URL to me. Just FYI, I never see the Distribution Wizard, just the "XWiki is initializing x% " countdown.

eban5 · June 19, 2018, 8:00pm

I may have worked it out. I was uncommenting xwiki.cfg’s virtual.usepath.servletpath=wiki and usepath-1 as well as a few other customizations not related to the servlet path building. I would then leave those default values untouched and just let that field be picked up by XWiki on startup.

Strangely, commenting them out again and letting XWiki pick up their default values seemed to do the trick.