[jira] [Created] (MJAR-259) Archiving to jar is very slow

Discussion:

Claes Nordmark (JIRA)

2018-11-13 13:50:00 UTC

Claes Nordmark created MJAR-259:
-----------------------------------

Summary: Archiving to jar is very slow
Key: MJAR-259
URL: https://issues.apache.org/jira/browse/MJAR-259
Project: Maven JAR Plugin
Issue Type: Bug
Affects Versions: 3.1.0
Environment: Redhat7
Reporter: Claes Nordmark

Doing a stackdump while "maven-jar-plugin:3.1.0:jar (default-jar)" shows thread spending a lot of time in UnixNativeDispatcher.getgrgid.

This was not visible in java 8 and jar plugin version 2.6.

Our previous build time has been increased from 5min to 3h 30min.

Tested version Java 11 and 3.1.0 of maven-jar-plugin

{code:java}
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-jar-plugin</artifactId>
<version>${maven.jar.plugin.version}</version>
<configuration>
<forceCreation>true</forceCreation>
<archive>
<index>true</index>
<manifest>
<addClasspath>true</addClasspath>
</manifest>
</archive>
</configuration>
</plugin>

{code}

{code:java}
java.lang.Thread.State: RUNNABLE
at sun.nio.fs.UnixNativeDispatcher.getgrgid(***@11/Native Method)
at sun.nio.fs.UnixUserPrincipals.fromGid(***@11/UnixUserPrincipals.java:129)
at sun.nio.fs.UnixFileAttributes.group(***@11/UnixFileAttributes.java:208)
- locked <0x000000067c2b31f0> (a sun.nio.fs.UnixFileAttributes)
at sun.nio.fs.UnixFileAttributeViews$Posix.addRequestedPosixAttributes(***@11/UnixFileAttributeViews.java:214)
at sun.nio.fs.UnixFileAttributeViews$Unix.readAttributes(***@11/UnixFileAttributeViews.java:362)
at sun.nio.fs.AbstractFileSystemProvider.readAttributes(***@11/AbstractFileSystemProvider.java:94)
at java.nio.file.Files.readAttributes(***@11/Files.java:1996)
at org.codehaus.plexus.components.io.attributes.FileAttributes.<init>(FileAttributes.java:67)
at org.codehaus.plexus.components.io.resources.PlexusIoFileResourceCollection.addResources(PlexusIoFileResourceCollection.java:156)
at org.codehaus.plexus.components.io.resources.PlexusIoFileResourceCollection.getResources(PlexusIoFileResourceCollection.java:254)
at org.codehaus.plexus.archiver.AbstractArchiver$1.hasNext(AbstractArchiver.java:506)
at org.codehaus.plexus.archiver.zip.AbstractZipArchiver.createArchiveMain(AbstractZipArchiver.java:256)
at org.codehaus.plexus.archiver.zip.AbstractZipArchiver.execute(AbstractZipArchiver.java:234)
at org.codehaus.plexus.archiver.AbstractArchiver.createArchive(AbstractArchiver.java:987)
at org.apache.maven.archiver.MavenArchiver.createArchive(MavenArchiver.java:649)
at org.apache.maven.plugins.jar.AbstractJarMojo.createArchive(AbstractJarMojo.java:224)
at org.apache.maven.plugins.jar.AbstractJarMojo.execute(AbstractJarMojo.java:255)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:137)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:154)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:146)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.builder.multithreaded.MultiThreadedBuilder$1.call(MultiThreadedBuilder.java:200)
at org.apache.maven.lifecycle.internal.builder.multithreaded.MultiThreadedBuilder$1.call(MultiThreadedBuilder.java:196)
at java.util.concurrent.FutureTask.run(***@11/FutureTask.java:264)
at java.util.concurrent.Executors$RunnableAdapter.call(***@11/Executors.java:515)
at java.util.concurrent.FutureTask.run(***@11/FutureTask.java:264)
at java.util.concurrent.ThreadPoolExecutor.runWorker(***@11/ThreadPoolExecutor.java:1128)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(***@11/ThreadPoolExecutor.java:628)
at java.lang.Thread.run(***@11/Thread.java:834){code}

--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Claes Nordmark (JIRA)

2018-11-23 13:25:00 UTC

Permalink

[ https://issues.apache.org/jira/browse/MJAR-259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16697127#comment-16697127 ]

Claes Nordmark commented on MJAR-259:
-------------------------------------

Narrowed down to https://github.com/codehaus-plexus/plexus-io/pull/17 :) made a push for a fix to plexus-io

Post by Claes Nordmark (JIRA)
Archiving to jar is very slow
-----------------------------
Key: MJAR-259
URL: https://issues.apache.org/jira/browse/MJAR-259
Project: Maven JAR Plugin
Issue Type: Bug
Affects Versions: 3.1.0
Environment: Redhat7
Reporter: Claes Nordmark
Priority: Major
Doing a stackdump while "maven-jar-plugin:3.1.0:jar (default-jar)" shows thread spending a lot of time in UnixNativeDispatcher.getgrgid.
This was not visible in java 8 and jar plugin version 2.6.
Our previous build time has been increased from 5min to 3h 30min.
Tested version Java 11 and 3.1.0 of maven-jar-plugin

{code:java}
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-jar-plugin</artifactId>
<version>${maven.jar.plugin.version}</version>
<configuration>
<forceCreation>true</forceCreation>
<archive>
<index>true</index>
<manifest>
<addClasspath>true</addClasspath>
</manifest>
</archive>
</configuration>
</plugin>

{code}

{code:java}
java.lang.Thread.State: RUNNABLE
- locked <0x000000067c2b31f0> (a sun.nio.fs.UnixFileAttributes)
at org.codehaus.plexus.components.io.attributes.FileAttributes.<init>(FileAttributes.java:67)
at org.codehaus.plexus.components.io.resources.PlexusIoFileResourceCollection.addResources(PlexusIoFileResourceCollection.java:156)
at org.codehaus.plexus.components.io.resources.PlexusIoFileResourceCollection.getResources(PlexusIoFileResourceCollection.java:254)
at org.codehaus.plexus.archiver.AbstractArchiver$1.hasNext(AbstractArchiver.java:506)
at org.codehaus.plexus.archiver.zip.AbstractZipArchiver.createArchiveMain(AbstractZipArchiver.java:256)
at org.codehaus.plexus.archiver.zip.AbstractZipArchiver.execute(AbstractZipArchiver.java:234)
at org.codehaus.plexus.archiver.AbstractArchiver.createArchive(AbstractArchiver.java:987)
at org.apache.maven.archiver.MavenArchiver.createArchive(MavenArchiver.java:649)
at org.apache.maven.plugins.jar.AbstractJarMojo.createArchive(AbstractJarMojo.java:224)
at org.apache.maven.plugins.jar.AbstractJarMojo.execute(AbstractJarMojo.java:255)
at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:137)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:208)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:154)
at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:146)
at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:117)
at org.apache.maven.lifecycle.internal.builder.multithreaded.MultiThreadedBuilder$1.call(MultiThreadedBuilder.java:200)
at org.apache.maven.lifecycle.internal.builder.multithreaded.MultiThreadedBuilder$1.call(MultiThreadedBuilder.java:196)