Skip to content

maven protobuf plugin not work properly #2277

Closed

Description

@asfimport

I checked out master branch and executed "mvn clean install -DskipTests", it failed to build with following error:

[ERROR] Failed to execute goal com.github.os72:protoc-jar-maven-plugin:3.6.0.1:run (generate-sources) on project parquet-protobuf: Error extracting protoc for version 3.5.1: Unsupported platform: protoc-3.5.1-linux-x86_64.exe -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
[ERROR]
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR] mvn -rf :parquet-protobuf

After I updated the plugin version as same as protobuf version, it pass the build.

--- a/parquet-protobuf/pom.xml
+++ b/parquet-protobuf/pom.xml
@@ -159,7 +159,7 @@
       <plugin>
         <groupId>com.github.os72</groupId>
         <artifactId>protoc-jar-maven-plugin</artifactId>
-        <version>3.6.0.1</version>
+        <version>3.5.1</version>
         <executions>
           <execution>
             <id>generate-sources</id>

Do we need to set this version to ${protobuf.version}?

Reporter: Junjie Chen / @chenjunjiedada
Assignee: Gabor Szadovszky / @gszadovszky

Note: This issue was originally created as PARQUET-1493. Please see the migration documentation for further details.

Activity

  1. asfimport commented on Jan 16, 2019

    @asfimport
    Author

    Gabor Szadovszky / @gszadovszky:
    @chenjunjiedada,
    What environment do you have? Is linux-x86_64 correct?
    I'm using Linux Mint 19.1 and it works fine. Travis builds also succeed after this change.
    The version number of the plugin and the protobuf version number are not in a tight relation. It should work fine as is.
    The latest plugin version is 3.6.0.2. Could you please try upgrading if it fixes your problem?

  2. asfimport commented on Jan 16, 2019

    @asfimport
    Author

    Junjie Chen / @chenjunjiedada:
    Hi @gszadovszky

    I just tried 3.6.0.2, still failed.  I'm using ubuntu18.04. (uname output: 4.15.0-43-generic #46-Ubuntu SMP Thu Dec 6 14:45:28 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux)

    [INFO] Apache Parquet Protobuf ............................ FAILURE [ 30.834 s]
    [INFO] Apache Parquet Scala ............................... SKIPPED
    [INFO] Apache Parquet Scrooge ............................. SKIPPED
    [INFO] Apache Parquet Hadoop Bundle ....................... SKIPPED
    [INFO] Apache Parquet Hive ................................ SKIPPED
    [INFO] Apache Parquet Hive Binding Parent ................. SKIPPED
    [INFO] Apache Parquet Hive Binding Interface .............. SKIPPED
    [INFO] Apache Parquet Hive 0.10 Binding ................... SKIPPED
    [INFO] Apache Parquet Hive 0.12 Binding ................... SKIPPED
    [INFO] Apache Parquet Hive Binding Factory ................ SKIPPED
    [INFO] Apache Parquet Hive Binding Bundle ................. SKIPPED
    [INFO] Apache Parquet Hive Storage Handler ................ SKIPPED
    [INFO] Apache Parquet Hive Bundle ......................... SKIPPED
    [INFO] Apache Parquet Tools ............................... SKIPPED
    [INFO] ------------------------------------------------------------------------
    [INFO] BUILD FAILURE
    [INFO] ------------------------------------------------------------------------
    [INFO] Total time: 01:10 min
    [INFO] Finished at: 2019-01-17T05:08:43+08:00
    [INFO] Final Memory: 115M/1593M
    [INFO] ------------------------------------------------------------------------
    [ERROR] Failed to execute goal com.github.os72:protoc-jar-maven-plugin:3.6.0.2:run (generate-sources) on project parquet-protobuf: Error extracting protoc for version 3.5.1: Unsupported platform: protoc-3.5.1-linux-x86_64.exe -> [Help 1]
    [ERROR]
    [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
    [ERROR] Re-run Maven using the -X switch to enable full debug logging.
    [ERROR]
    [ERROR] For more information about the errors and possible solutions, please read the following articles:
    [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoExecutionException
    [ERROR]
    [ERROR] After correcting the problems, you can resume the build with the command
    [ERROR]   mvn -rf :parquet-protobuf

  3. asfimport commented on Jan 16, 2019

    @asfimport
    Author

    Gabor Szadovszky / @gszadovszky:
    Hi @chenjunjiedada,

    So far, you are the only one who has issues with this plugin. Instead of downgrading the plugin globally, I would suggest to use the plugin version which works for you as a workaround and file an issue for the plugin at https://github.com/os72/protoc-jar-maven-plugin/issues. Let's see, if they can say something.
    (Maybe, you'd like to execute the maven command with -X and -e so you'll get some more info.)

    Keep this issue open until we know more about the problem.

  4. asfimport commented on Jan 16, 2019

    @asfimport
    Author
  5. asfimport commented on Jan 21, 2019

    @asfimport
    Author

    Gabor Szadovszky / @gszadovszky:
    Since it turned out the issue is at the plugin side I'm closing this one.

  6. asfimport commented on Feb 25, 2021

    @asfimport
    Author

    Gabor Szadovszky / @gszadovszky:
    We have also hit by this issue in our internal environment so I've looked into the bug report of the plugin. It seems I was to fast closing this issue as even the plugin has the bug we still need to upgrade to the version where it is fixed. Also it seems safer to use protocArtifact instead of protocVersion to be 100% sure that the actual maven settings takes place when downloading the binaries.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions