Release Hi3D v1.0 model weights and documentation
Browse files- AUTHORS +26 -0
- LICENSE +223 -0
- NOTICE +49 -0
- README.md +169 -21
- README.zh-CN.md +169 -23
- THIRD_PARTY_LICENSES.md +474 -0
- model_index.json +9 -0
- scheduler/scheduler_config.json +6 -0
- sparc3d/ops/flexicubes/LICENSE.txt +202 -0
- transformer_1024/config.json +84 -0
- transformer_1024/model.safetensors +3 -0
- transformer_512/config.json +84 -0
- transformer_512/model.safetensors +3 -0
- vae/config.json +9 -0
- vae/model.safetensors +3 -0
AUTHORS
ADDED
|
@@ -0,0 +1,26 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
SPARC3D authors and contributors
|
| 2 |
+
================================
|
| 3 |
+
|
| 4 |
+
Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes
|
| 5 |
+
Modeling — https://arxiv.org/abs/2505.14521
|
| 6 |
+
|
| 7 |
+
Paper authors
|
| 8 |
+
-------------
|
| 9 |
+
|
| 10 |
+
Zhihao Li
|
| 11 |
+
Yufei Wang
|
| 12 |
+
Heliang Zheng
|
| 13 |
+
Yihao Luo
|
| 14 |
+
Bihan Wen
|
| 15 |
+
|
| 16 |
+
Component credits
|
| 17 |
+
-----------------
|
| 18 |
+
|
| 19 |
+
Named here because the credit belongs with the code, not only with the paper.
|
| 20 |
+
|
| 21 |
+
Zhihao Li GPU surface voxelization in sparc3d/ops, originally written as
|
| 22 |
+
the pytorch-voxelization extension and implemented as Triton
|
| 23 |
+
kernels for this release.
|
| 24 |
+
|
| 25 |
+
Third-party code redistributed with this package is credited separately in
|
| 26 |
+
NOTICE and THIRD_PARTY_LICENSES.md.
|
LICENSE
ADDED
|
@@ -0,0 +1,223 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Hi3D Open License Agreement Version 1.0
|
| 2 |
+
|
| 3 |
+
| Item | Details |
|
| 4 |
+
| --- | --- |
|
| 5 |
+
| Licensor | OCEANO HK HOLDING LIMITED |
|
| 6 |
+
| Licensed Project | Hi3D V1.0 |
|
| 7 |
+
| Version | Version 1.0 |
|
| 8 |
+
| Date | October 22, 2026 |
|
| 9 |
+
|
| 10 |
+
|
| 11 |
+
|
| 12 |
+
IMPORTANT NOTICE: By downloading, accessing, using, reproducing, modifying, distributing, displaying or otherwise exercising any rights in the Hi3D Materials, you acknowledge that you have read, understood and agreed to this Agreement. If you do not agree to this Agreement, do not use the Hi3D Materials.
|
| 13 |
+
|
| 14 |
+
# 1 Definitions
|
| 15 |
+
|
| 16 |
+
For purposes of this Agreement, the following terms have the meanings set out below.
|
| 17 |
+
|
| 18 |
+
## 1.1 Agreement
|
| 19 |
+
|
| 20 |
+
"Agreement" means this Hi3D Open License Agreement Version 1.0 issued with the applicable version of the Hi3D Materials, including Schedule 1, Acceptable Use Policy, and Schedule 2, Licensed Asset Schedule.
|
| 21 |
+
|
| 22 |
+
## 1.2 Licensor
|
| 23 |
+
|
| 24 |
+
"Licensor," "we," "us" or "our" means OCEANO HK HOLDING LIMITED, solely to the extent that it owns or is authorized to license the relevant rights in the Hi3D Materials.
|
| 25 |
+
|
| 26 |
+
## 1.3 You
|
| 27 |
+
|
| 28 |
+
"You" means the individual or legal entity exercising rights under this Agreement. A "legal entity" includes the entity acting hereunder and any entity that controls, is controlled by, or is under common control with it. "Control" means direct or indirect ownership of more than fifty percent of the voting interests, or the power to direct management.
|
| 29 |
+
|
| 30 |
+
## 1.4 Hi3D Materials
|
| 31 |
+
|
| 32 |
+
"Hi3D Materials" means the source code, model architecture, model weights and parameters, inference code, documentation and other materials that are owned by or licensable by the Licensor and expressly identified in the specific release listed in Schedule 2 as being subject to this Agreement. An asset is not automatically included in this Agreement merely because it has a similar name or purpose or is stored in the same repository, unless it has actually been released and is listed in Schedule 2.
|
| 33 |
+
|
| 34 |
+
## 1.5 Excluded Materials
|
| 35 |
+
|
| 36 |
+
"Excluded Materials" means third-party software, models, weights and their outputs; training, validation and test datasets; sample media, fonts and other third-party assets; first-stage systems or server-side code not listed in Schedule 2; trademarks and brand assets except as expressly permitted under Section 8; and any other items expressly subject to separate terms. Excluded Materials are not licensed under this Agreement. Sample code calling a third-party model does not alter the licensing status of that third-party model or its outputs.
|
| 37 |
+
|
| 38 |
+
## 1.6 Model Derivative
|
| 39 |
+
|
| 40 |
+
"Model Derivative" means another machine-learning model created by modifying, fine-tuning, adapting or quantizing all or a substantial part of the Hi3D model weights or parameters, or otherwise based on or incorporating the foregoing. Standalone Outputs, including generated 3D meshes and model files and finished works created by editing, converting or combining such files, do not become Model Derivatives merely because they were generated or post-processed; however, any portion of a finished work that actually contains Hi3D code, weights or parameters remains subject to this Agreement according to its nature.
|
| 41 |
+
|
| 42 |
+
## 1.7 Output
|
| 43 |
+
|
| 44 |
+
"Output" means content or information generated by running the Hi3D Materials or a Model Derivative, including generated 3D geometry, meshes and exported 3D files. Any third-party asset actually contained in an Output remains subject to the applicable third-party rights or separate license.
|
| 45 |
+
|
| 46 |
+
## 1.8 Commercial Product or Service
|
| 47 |
+
|
| 48 |
+
"Commercial Product or Service" means any product, service or hosted functionality that uses or contains the Hi3D Materials or a Model Derivative and is offered for commercial advantage, monetary consideration, revenue generation or other material commercial benefit.
|
| 49 |
+
|
| 50 |
+
## 1.9 Related Product or Service
|
| 51 |
+
|
| 52 |
+
"Related Product or Service" means a product or service that uses or contains the Hi3D Materials or a Model Derivative. Substantially similar services split among different brands, applications, interfaces, domain names or affiliated entities to evade the Scale Threshold must be aggregated.
|
| 53 |
+
|
| 54 |
+
## 1.10 Monthly Active Users
|
| 55 |
+
|
| 56 |
+
"Monthly Active Users" or "MAU" means the number of unique natural persons who actively use a Related Product or Service during a calendar month.
|
| 57 |
+
|
| 58 |
+
## 1.11 First Stage
|
| 59 |
+
|
| 60 |
+
"First Stage" means coarse-mesh generation that generates the basic three-dimensional shape of an object from a reference image, determines its principal structure and approximate contours, and outputs a coarse mesh for subsequent processing.
|
| 61 |
+
|
| 62 |
+
## 1.12 Second Stage
|
| 63 |
+
|
| 64 |
+
"Second Stage" means geometry refinement that takes a reference image and the coarse mesh produced by the First Stage as inputs, progressively refines the three-dimensional shape, and generates higher-resolution three-dimensional geometry and mesh files.
|
| 65 |
+
|
| 66 |
+
# 2 License Grant
|
| 67 |
+
|
| 68 |
+
Subject to your continuing compliance with this Agreement, and solely with respect to rights in the Hi3D Materials that the Licensor owns or is authorized to license, the Licensor grants you a worldwide, non-exclusive, royalty-free license to use, reproduce, modify, fine-tune and adapt the Hi3D Materials in source-code, object-code, weight or other applicable form; create Model Derivatives and other derivative works; publicly display and publicly perform them; and distribute, sublicense and sell the Hi3D Materials. You may also deploy the Hi3D Materials on servers, cloud platforms or other computing environments that you control or lawfully use, and provide third parties with hosted services based on the Hi3D Materials through websites, applications, application programming interfaces (APIs), software as a service (SaaS) or other remote-access methods. This license may be transferred only through sublicensing or distribution that complies with this Agreement.
|
| 69 |
+
|
| 70 |
+
## 2.1 Commercial Use
|
| 71 |
+
|
| 72 |
+
Commercial use is permitted subject to Sections 5, 6, 7 and 8. No revenue threshold applies separately from Section 5.
|
| 73 |
+
|
| 74 |
+
## 2.2 Training Other AI Models
|
| 75 |
+
|
| 76 |
+
To the extent the Licensor has the right to grant such permission, you may use the Hi3D Materials and their Outputs to train, evaluate, improve or develop other artificial-intelligence or machine-learning models, subject to applicable law, third-party rights and Schedule 1. This permission does not extend to coarse models, outputs or other third-party materials generated through third-party models, and does not replace their separate license terms. Another model is a Model Derivative only if it satisfies the definition in Section 1.6.
|
| 77 |
+
|
| 78 |
+
# 3 Patent License
|
| 79 |
+
|
| 80 |
+
Subject to your compliance with this Agreement, and solely with respect to patent claims that the Licensor owns or is authorized to license and that are necessarily infringed by implementation of the Hi3D Materials, the Licensor grants you a perpetual, worldwide, non-exclusive, royalty-free patent license to make, have made, use, offer for sale, sell, import and otherwise transfer the Hi3D Materials. A patent license from any other contributor arises only if that contributor has the right to grant it and expressly agrees to provide it under this Agreement.
|
| 81 |
+
|
| 82 |
+
## 3.1 Patent Litigation
|
| 83 |
+
|
| 84 |
+
If you institute patent litigation against the Licensor or any contributor alleging that the Hi3D Materials or a contribution directly or contributorily infringes a patent, all patent licenses granted to you under this Agreement for the Hi3D Materials terminate as of the date the claim is filed.
|
| 85 |
+
|
| 86 |
+
# 4 Distribution and Sublicensing Conditions
|
| 87 |
+
|
| 88 |
+
You may distribute the Hi3D Materials and Model Derivatives, including as part of a proprietary or closed-source product, only if you comply with all of the following conditions. Merely reproducing, editing, displaying, selling or distributing Outputs that do not contain Hi3D Materials or Model Derivatives is not distribution under this Section, and does not by itself require those Outputs to be accompanied by this Agreement, a NOTICE file or a modification notice.
|
| 89 |
+
|
| 90 |
+
- Provide each recipient of files containing the Hi3D Materials or a Model Derivative with the full text of this Agreement upon delivery, or a link that provides continuous, free access to the full text of the corresponding version of this Agreement.
|
| 91 |
+
- Retain all applicable copyright, patent and attribution notices contained in the Hi3D Materials.
|
| 92 |
+
- Prominently identify the files, weights or materials that you modified.
|
| 93 |
+
- When distributing files containing the Hi3D Materials or a Model Derivative, include a readable NOTICE file containing the notice specified in Section 8.2 and all applicable original third-party notices and license requirements.
|
| 94 |
+
- Ensure that your terms do not restrict recipients from exercising the rights granted under this Agreement in unmodified portions of the Hi3D Materials, and pass the Acceptable Use Policy downstream as an enforceable condition.
|
| 95 |
+
|
| 96 |
+
## 4.1 Licensing of Model Derivatives
|
| 97 |
+
|
| 98 |
+
You may apply different terms, including proprietary terms, to your own modifications and to a Model Derivative as a whole; however, the portions that actually reproduce or embed Hi3D code, weights or parameters remain subject to this Agreement, and the applicable attribution, branding, scale and use conditions continue to apply. A finished 3D work containing only Outputs and not the foregoing Hi3D Materials is not subject to this subsection's conditions for Model Derivatives merely because it was generated using Hi3D.
|
| 99 |
+
|
| 100 |
+
# 5 Scale Threshold and Separate License
|
| 101 |
+
|
| 102 |
+
The Scale Threshold is triggered if one or more Related Products or Services exceed 200,000 Monthly Active Users in the most recent complete calendar month or generate monthly revenue of at least USD 1,000,000. Except for the anti-circumvention aggregation rule in Section 1.9, only Related Products or Services are counted.
|
| 103 |
+
|
| 104 |
+
## 5.1 Application
|
| 105 |
+
|
| 106 |
+
Within sixty days after first triggering the Scale Threshold, you must notify OCEANO HK HOLDING LIMITED and apply for a separate written license. The application must truthfully disclose the applicant, the affected products and services, the MAU calculation methodology, use cases, deployment regions, security measures and any other information reasonably requested by us.
|
| 107 |
+
|
| 108 |
+
## 5.2 Transition Period
|
| 109 |
+
|
| 110 |
+
If you submit a complete, truthful and timely application and remain compliant, you may continue your existing use during the sixty-day application period and while both parties are actively negotiating in good faith; however, without our written consent, you may not materially expand the affected use beyond its scale and scope when the Scale Threshold was first exceeded.
|
| 111 |
+
|
| 112 |
+
## 5.3 Decision on Separate License
|
| 113 |
+
|
| 114 |
+
A separate license may include fees, branding, reporting, audit, security, service-level or other commercial terms. We may decide, in our sole discretion, whether to grant or deny a separate license. No separate license is effective unless signed by an authorized representative of OCEANO HK HOLDING LIMITED or otherwise expressly confirmed by it in writing.
|
| 115 |
+
|
| 116 |
+
## 5.4 Failure to Obtain a License
|
| 117 |
+
|
| 118 |
+
If you fail to apply within the required period, make a materially false statement in an application, or continue the affected use after written denial or after good-faith negotiations end without agreement, your right to continue above-threshold use terminates. Any continuing above-threshold use is unauthorized and constitutes a material breach.
|
| 119 |
+
|
| 120 |
+
# 6 Acceptable Use Policy
|
| 121 |
+
|
| 122 |
+
Your use of the Hi3D Materials and Model Derivatives, and your conduct in generating Outputs with them, must comply with Schedule 1, applicable law and third-party rights. This Agreement does not otherwise restrict the ordinary reproduction, editing, display, sale or distribution of Outputs that have been generated and do not contain Hi3D Materials or Model Derivatives; you remain responsible for complying with applicable law and any third-party rights contained in the Outputs. You may not knowingly assist another person in circumventing restrictions on the use of the Hi3D Materials or Model Derivatives.
|
| 123 |
+
|
| 124 |
+
## 6.1 Policy Version
|
| 125 |
+
|
| 126 |
+
The version of Schedule 1 accompanying the Hi3D version you receive applies to that version. We may issue a revised policy for later versions. Material revisions do not apply retroactively to prior versions unless you expressly accept them.
|
| 127 |
+
|
| 128 |
+
# 7 Commercial Branding Display
|
| 129 |
+
|
| 130 |
+
Any entity integrating the Hi3D Materials or a Model Derivative into a Commercial Product or Service must display "Powered by Hi3D 1.0" clearly and with reasonable prominence. A product with a user interface must display it in the interface, on an About page or in product acknowledgements. An API, SDK, backend or embedded product without a conventional user interface must display it in primary customer-accessible technical documentation, a service description or a legal notice. Where the display location supports a clickable link, the text must link to the official Hi3D website listed in Schedule 2; if a link cannot be provided, the official website address must be stated in the same location or related documentation. Merely obtaining or using a generated 3D Output file does not, by itself, create the branding-display obligation under this Section.
|
| 131 |
+
|
| 132 |
+
You may use the Licensor's commercial marks only to comply with the branding-display obligation under this Section. This permission may be revoked at any time and does not transfer any rights or constitute the Licensor's endorsement of you or any related product or service. The Licensor may require you in writing to cease using or remove the relevant marks, and you must do so within five (5) business days after receiving the notice. Once the marks have been removed, you will no longer be subject to the corresponding branding-display obligation.
|
| 133 |
+
|
| 134 |
+
## 7.1 No Endorsement
|
| 135 |
+
|
| 136 |
+
Unless we expressly agree in writing, you may not state or imply that your product, service, Model Derivative or Output was created, certified, endorsed or supported by OCEANO HK HOLDING LIMITED, or is an official Hi3D product.
|
| 137 |
+
|
| 138 |
+
# 8 Trademarks and Notices
|
| 139 |
+
|
| 140 |
+
Except for the limited license below, this Agreement grants no right to use the names, logos, trade dress, domain names or trademarks of OCEANO HK HOLDING LIMITED, Hi3D or their affiliates. Reasonable descriptive use to identify the source of the Hi3D Materials is permitted.
|
| 141 |
+
|
| 142 |
+
## 8.1 Limited Mark License
|
| 143 |
+
|
| 144 |
+
While you remain in compliance with this Agreement, we grant you a limited, non-exclusive, non-transferable and non-sublicensable license to use the "Hi3D" word mark only to the extent necessary to comply with Sections 4 and 7. This license terminates when your right to use the relevant Hi3D Materials terminates under Section 14. It does not include use of any logo or any use that implies endorsement, sponsorship or official status. All goodwill belongs to the applicable trademark owner.
|
| 145 |
+
|
| 146 |
+
## 8.2 Required Notice
|
| 147 |
+
|
| 148 |
+
The NOTICE file must state: "Hi3D is licensed under the Hi3D Open License Agreement Version 1.0. Copyright © 2026 OCEANO HK HOLDING LIMITED. All rights not expressly granted are reserved. The Hi3D trademarks are owned by OCEANO HK HOLDING LIMITED or its applicable affiliate(s)."
|
| 149 |
+
|
| 150 |
+
# 9 Outputs
|
| 151 |
+
|
| 152 |
+
As between you and us, we claim no ownership of Outputs generated by you. So long as an Output itself does not contain Hi3D Materials or a Model Derivative, you and downstream users who obtain that Output may reproduce, edit, display, sell and distribute it without being required, solely because of that use, to display "Powered by Hi3D 1.0," include this Agreement or a NOTICE file, or apply for a scale-based license under Section 5. This Section does not transfer rights and does not guarantee that an Output is copyrightable, original or non-infringing. Any applicable terms governing third-party models, inputs, materials or services must still be observed.
|
| 153 |
+
|
| 154 |
+
# 10 Third-Party Materials
|
| 155 |
+
|
| 156 |
+
Third-party software, models, weights and their outputs remain subject to their respective licenses and terms of use, and you are responsible for independently obtaining and complying with the relevant rights. Sample code included with this release may call Hunyuan3D-2mini to generate a first-stage coarse model, but Hi3D does not license that model's software, weights or outputs under this Agreement; the model version, source and license used by the sample must be identified in the release documentation. Other external models loaded for second-stage inference, and their actual versions, must also be listed in the third-party dependency schedule. Unless expressly stated otherwise, this Agreement does not license training data, sample media, fonts, datasets or other Excluded Materials.
|
| 157 |
+
|
| 158 |
+
# 11 Disclaimer
|
| 159 |
+
|
| 160 |
+
TO THE MAXIMUM EXTENT PERMITTED BY LAW, THE HI3D MATERIALS, MODEL DERIVATIVES, OUTPUTS AND ALL RELATED RIGHTS ARE PROVIDED "AS IS" AND "AS AVAILABLE," WITHOUT WARRANTIES OF ANY KIND, WHETHER EXPRESS, IMPLIED OR STATUTORY, INCLUDING WARRANTIES OF TITLE, NON-INFRINGEMENT, MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, ACCURACY, SECURITY, RELIABILITY OR UNINTERRUPTED OPERATION. YOU ARE RESPONSIBLE FOR DETERMINING WHETHER YOUR USE IS APPROPRIATE AND LAWFUL.
|
| 161 |
+
|
| 162 |
+
# 12 Limitation of Liability
|
| 163 |
+
|
| 164 |
+
TO THE MAXIMUM EXTENT PERMITTED BY LAW, OCEANO HK HOLDING LIMITED, ITS AFFILIATES AND CONTRIBUTORS WILL NOT BE LIABLE FOR ANY INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, PUNITIVE OR CONSEQUENTIAL DAMAGES, OR FOR ANY LOSS OF PROFITS, REVENUE, DATA OR GOODWILL, OR BUSINESS INTERRUPTION, ARISING FROM THIS AGREEMENT OR THE HI3D MATERIALS, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH LOSS. LIABILITY THAT CANNOT LAWFULLY BE EXCLUDED IS NOT EXCLUDED BY THIS SECTION.
|
| 165 |
+
|
| 166 |
+
# 13 Indemnification
|
| 167 |
+
|
| 168 |
+
You will, to the applicable extent, defend, indemnify and hold harmless OCEANO HK HOLDING LIMITED, its affiliates, officers, employees and contributors from and against third-party claims, losses, liabilities, damages, judgments, costs and reasonable legal fees arising from your breach of this Agreement; unlawful use; inputs; Outputs; modifications; Model Derivatives; products; services; or distribution. We will promptly notify you of a claim and, at your expense, provide reasonable assistance and permit you to control the defense and settlement; however, without the indemnified party's prior written consent, you may not admit liability on its behalf, impose obligations on it or agree to non-monetary relief against it.
|
| 169 |
+
|
| 170 |
+
# 14 Term and Termination
|
| 171 |
+
|
| 172 |
+
This Agreement takes effect when you first access the Hi3D Materials or exercise the relevant rights, and continues until terminated. Upon a material breach, your rights terminate immediately following our written notice. For any other breach, your rights terminate if you fail to cure within thirty days after our written notice. Patent termination under Section 3.1 and scale-based termination under Section 5.4 operate according to their respective terms.
|
| 173 |
+
|
| 174 |
+
## 14.1 Effect of Termination
|
| 175 |
+
|
| 176 |
+
Upon termination, you must cease any use no longer authorized under this Agreement and delete any Hi3D model weights and other Hi3D Materials in your possession or control that are required to be deleted. Records required by law and routine backups that cannot be immediately purged must not be used and must be deleted in accordance with the applicable retention period. Termination does not automatically terminate licenses lawfully granted before termination where downstream recipients remain compliant, but you may make no new distributions. Sections 1 and 7 through 16, and accrued rights, survive to the extent applicable.
|
| 177 |
+
|
| 178 |
+
# 15 Governing Law and Arbitration
|
| 179 |
+
|
| 180 |
+
This Agreement and any non-contractual obligations arising from it are governed by the laws of the Hong Kong Special Administrative Region, without regard to conflict-of-laws rules. Any dispute arising out of or relating to this Agreement will be finally resolved by arbitration administered by the Hong Kong International Arbitration Centre under the HKIAC Administered Arbitration Rules in force when the Notice of Arbitration is submitted. The seat of arbitration is Hong Kong, the tribunal will consist of one arbitrator, and the language of arbitration is English. Either party may seek urgent interim or injunctive relief from a court of competent jurisdiction.
|
| 181 |
+
|
| 182 |
+
# 16 General
|
| 183 |
+
|
| 184 |
+
This Agreement constitutes the entire agreement concerning this public license. To the extent a separate written commercial license expressly addresses a matter and conflicts with this Agreement, the commercial license controls. If any provision is unenforceable, it will be adjusted only to the minimum extent necessary and the remainder will remain in effect. Failure to enforce a right is not a waiver. Headings and translations do not affect the meaning of the terms. Except for a permitted transfer with a related product or business where the transferee accepts this Agreement, you may not assign this Agreement.
|
| 185 |
+
|
| 186 |
+
## 16.1 Non-Retroactive Updates
|
| 187 |
+
|
| 188 |
+
The license text accompanying the version of the Hi3D Materials you receive continues to apply to that version. We may license later versions under revised terms, but revisions do not retroactively alter rights already granted for earlier versions.
|
| 189 |
+
|
| 190 |
+
## 16.2 Contact
|
| 191 |
+
|
| 192 |
+
Applications for scale-based licenses and legal notices must be submitted using the contact details published on the official Hi3D release page, or sent to another address formally designated by OCEANO HK HOLDING LIMITED.
|
| 193 |
+
|
| 194 |
+
# Schedule 1 Acceptable Use Policy
|
| 195 |
+
|
| 196 |
+
You may not use the Hi3D Materials or Model Derivatives for any of the following activities, or generate or disseminate the prohibited content listed below through such use. This Schedule does not impose model-use obligations on a person merely because that person obtains or ordinarily uses a generated 3D finished work that does not contain Hi3D Materials or a Model Derivative; subsequent use of such a finished work remains subject to applicable law and third-party rights.
|
| 197 |
+
|
| 198 |
+
- Violate applicable law, sanctions, export controls, court orders or binding regulatory requirements;
|
| 199 |
+
- Infringe or misappropriate copyright, patent rights, trademark rights, trade secrets, privacy, data protection, publicity rights, image rights or other rights;
|
| 200 |
+
- Exploit, sexualize, groom or traffic minors, or otherwise harm minors;
|
| 201 |
+
- Create, distribute or facilitate malware, ransomware, unauthorized access, credential theft, destructive code or material network abuse;
|
| 202 |
+
- Deceptively impersonate another person, commit fraud, manipulate identity, or generate deceptive synthetic media without disclosure where disclosure is required by law;
|
| 203 |
+
- Intentionally facilitate violence, terrorism, self-harm, unlawful discrimination, stalking, harassment or targeted abuse;
|
| 204 |
+
- Unlawfully collect, infer, disclose or use personal or sensitive information, or undertake any of those activities for the purpose of harming another person;
|
| 205 |
+
- Circumvent technical safeguards or access controls in the Hi3D Materials, except for authorized good-faith security research conducted with appropriate safeguards;
|
| 206 |
+
- Make fully automated decisions in healthcare, employment, credit, housing, education, insurance, law enforcement or essential services that have legal or similarly significant effects, without legally required human oversight, testing, notice and appeal mechanisms; or
|
| 207 |
+
- Falsely represent a Model Derivative or product as an official Hi3D version or as endorsed by OCEANO HK HOLDING LIMITED.
|
| 208 |
+
|
| 209 |
+
This Policy does not prohibit lawful research, testing, auditing, red-teaming or development conducted with reasonable safeguards and not deployed for a prohibited purpose.
|
| 210 |
+
|
| 211 |
+
# Schedule 2 Licensed Asset Schedule
|
| 212 |
+
|
| 213 |
+
This Schedule identifies the assets in this release that are subject to the Hi3D Open License Agreement Version 1.0. The second-stage inference code, documentation and configuration listed below as "Included," together with the eight second-stage model files identified below for distribution under the name Hi3D v1.0 in the Hugging Face model repository at https://huggingface.co/hi3d-official/Hi3Dv1.0, are included under this Agreement to the extent the Licensor owns or is authorized to license them. Inclusion is not affected by the code and weights being stored separately on GitHub and Hugging Face. No third-party model, external dependency, unreleased first-stage material or file listed as "Excluded" is licensed under this Agreement.
|
| 214 |
+
|
| 215 |
+
| Item | Details |
|
| 216 |
+
| --- | --- |
|
| 217 |
+
| Code Release (Basis of Included Scope) | The Hi3D v1.0 source release at https://github.com/hi3d-official/Hi3Dv1.0 containing this Agreement. The included code, documentation and configuration are identified by the paths below. This Schedule applies to the files accompanying this version of the Agreement, not automatically to later repository versions. |
|
| 218 |
+
| Second-Stage Inference Code and Architecture (Included) | Under sparc3d/: models/, nn/, ops/, pipelines/, schedulers/, sparcubes/, structures/, utils/ and package initialization files; demo/refine_mesh.py, demo/image_to_mesh.py and demo/coarse_stage.py. Coverage is limited to implementations and modifications that the Licensor is authorized to license. coarse_stage.py is sample adapter code that calls an external Hunyuan model and does not include the Hunyuan code or weights. |
|
| 219 |
+
| Second-Stage Model Weights and Configuration (Included) | The following eight Hi3D v1.0 files are included under this Agreement at paths relative to the root of the Hugging Face model repository: model_index.json; scheduler/scheduler_config.json; transformer_512/config.json; transformer_512/model.safetensors (3,675,679,280 bytes); transformer_1024/config.json; transformer_1024/model.safetensors (3,675,679,280 bytes); vae/config.json; and vae/model.safetensors (376,629,712 bytes). transformer_1024/model.safetensors is used for both the 1024³ and 1536³ settings; there is no separate transformer_1536 weight in this release. The designated release location for these files is https://huggingface.co/hi3d-official/Hi3Dv1.0. This item excludes all other files in that repository and also excludes external models and weights such as Hunyuan3D-2mini, DINOv2 and CLIP. |
|
| 220 |
+
| Documentation and Configuration (Included to the Extent Licensable) | README.md, README.zh-CN.md, docs/installation.md, docs/pipeline.md and docs/reproduction.md, together with content in pyproject.toml, MANIFEST.in, docker/Dockerfile and docker/constraints.txt that the Licensor is authorized to license. Original notices in AUTHORS, NOTICE, THIRD_PARTY_LICENSES.md and third-party license files must be preserved unchanged. |
|
| 221 |
+
| Sample Media (Excluded) | assets/example.png, assets/framework.png, assets/global-comparison-1.jpg, assets/global-comparison-2.jpg and assets/local-detail-comparison.jpg are excluded. Their presence in this release does not grant any license to use them under this Agreement. Any use is subject to the applicable rights and separate permissions. |
|
| 222 |
+
| Unreleased and Third-Party Materials (Excluded) | Unreleased proprietary Hi3D first-stage materials, training code and datasets; original third-party rights in TRELLIS, Pointcept, O-CNN and FlexiCubes; Hunyuan3D-2mini code, weights and outputs called externally by the sample; and the facebook/dinov2-large and openai/clip-vit-large-patch14 weights separately obtained at runtime are not sublicensed under this Hi3D Agreement. Original third-party notices and their respective terms continue to apply. |
|
| 223 |
+
| Official Hi3D Websites | The link target for "Powered by Hi3D 1.0" under Section 7 is http://hi3d.ai/. The China website is https://www.hi3d.cn/. |
|
NOTICE
ADDED
|
@@ -0,0 +1,49 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
SPARC3D
|
| 2 |
+
Copyright 2026 The SPARC3D Authors
|
| 3 |
+
|
| 4 |
+
This product includes software developed by third parties. The following
|
| 5 |
+
components are redistributed under their own licenses, reproduced in full in
|
| 6 |
+
THIRD_PARTY_LICENSES.md:
|
| 7 |
+
|
| 8 |
+
* Microsoft TRELLIS (MIT License)
|
| 9 |
+
Copyright (c) Microsoft Corporation.
|
| 10 |
+
https://github.com/microsoft/TRELLIS
|
| 11 |
+
|
| 12 |
+
* Pointcept / Point Transformer V3 (MIT License)
|
| 13 |
+
Copyright (c) 2023 Pointcept
|
| 14 |
+
https://github.com/Pointcept/Pointcept
|
| 15 |
+
|
| 16 |
+
* O-CNN, ocnn-pytorch (MIT License)
|
| 17 |
+
Copyright (c) 2022 Peng-Shuai Wang <wangps@hotmail.com>
|
| 18 |
+
https://github.com/octree-nn/ocnn-pytorch
|
| 19 |
+
|
| 20 |
+
* NVIDIA FlexiCubes (Apache License 2.0)
|
| 21 |
+
Copyright (c) 2025 NVIDIA CORPORATION & AFFILIATES
|
| 22 |
+
https://github.com/nv-tlabs/FlexiCubes
|
| 23 |
+
License also included at sparc3d/ops/flexicubes/LICENSE.txt
|
| 24 |
+
|
| 25 |
+
GPU surface voxelization in sparc3d/ops descends from the PyTorch extension
|
| 26 |
+
written by Zhihao Li; see AUTHORS.
|
| 27 |
+
|
| 28 |
+
|
| 29 |
+
Hi3D v1.0
|
| 30 |
+
---------
|
| 31 |
+
Hi3D v1.0 includes the SPARC3D inference implementation. Original copyright,
|
| 32 |
+
attribution, license texts, and per-file modification notices are retained.
|
| 33 |
+
The Python package and API names are sparc3d / Sparc3DPipeline.
|
| 34 |
+
|
| 35 |
+
Hunyuan3D is referenced only by an optional coarse-mesh example adapter. Tencent's
|
| 36 |
+
Hunyuan3D implementation and weights are not bundled with or relicensed by this
|
| 37 |
+
distribution. External image encoders and any separately obtained model weights
|
| 38 |
+
retain their own terms. See THIRD_PARTY_LICENSES.md for the source and model
|
| 39 |
+
license index.
|
| 40 |
+
|
| 41 |
+
|
| 42 |
+
Hi3D Open License Agreement Version 1.0 notice
|
| 43 |
+
--------------------------------------------
|
| 44 |
+
The following notice applies to the Hi3D Materials identified in Schedule 2 of
|
| 45 |
+
LICENSE, only to the extent OCEANO HK HOLDING LIMITED owns or is authorized to
|
| 46 |
+
license them. It does not replace the original third-party notices above or
|
| 47 |
+
extend the Agreement to Excluded Materials. See THIRD_PARTY_LICENSES.md.
|
| 48 |
+
|
| 49 |
+
Hi3D is licensed under the Hi3D Open License Agreement Version 1.0. Copyright © 2026 OCEANO HK HOLDING LIMITED. All rights not expressly granted are reserved. The Hi3D trademarks are owned by OCEANO HK HOLDING LIMITED or its applicable affiliate(s).
|
README.md
CHANGED
|
@@ -7,6 +7,9 @@ tags:
|
|
| 7 |
- geometry-refinement
|
| 8 |
- sparc3d
|
| 9 |
- image-to-3d
|
|
|
|
|
|
|
|
|
|
| 10 |
---
|
| 11 |
|
| 12 |
# Hi3D v1.0
|
|
@@ -17,29 +20,29 @@ tags:
|
|
| 17 |
|
| 18 |
**[Live Demo](https://huggingface.co/spaces/ilcve21/Sparc3D)** · [GitHub Repository](https://github.com/hi3d-official/Hi3Dv1.0) · [International Website](http://hi3d.ai/) · [China Website](https://www.hi3d.cn/)
|
| 19 |
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
This Hugging Face repository mirrors the [official GitHub project preview](https://github.com/hi3d-official/Hi3Dv1.0). It contains project documentation, the system overview, and selected visual comparisons. No source code or model weights are included yet.
|
| 23 |
|
| 24 |
## Overview
|
| 25 |
|
| 26 |
-
Hi3D v1.0
|
|
|
|
|
|
|
| 27 |
|
| 28 |
-
|
| 29 |
|
| 30 |
## System overview
|
| 31 |
|
| 32 |
[](https://huggingface.co/hi3d-official/Hi3Dv1.0/resolve/main/assets/framework.png)
|
| 33 |
|
| 34 |
-
Image features condition sparse flow on coordinates derived from the coarse geometry.
|
| 35 |
|
| 36 |
-
|
|
| 37 |
-
| --- | --- | --- |
|
| 38 |
-
| 1 | 64³ | 512³ |
|
| 39 |
-
| 2 | 128³ | 1024³ |
|
| 40 |
-
| 3 | 192³ | 1536³ |
|
| 41 |
|
| 42 |
-
These labels describe nominal sparse coordinate and
|
| 43 |
|
| 44 |
## Visual comparisons
|
| 45 |
|
|
@@ -53,25 +56,170 @@ Red boxes mark the reference regions enlarged in each row. Shaded geometry and c
|
|
| 53 |
|
| 54 |
[](https://huggingface.co/hi3d-official/Hi3Dv1.0/resolve/main/assets/global-comparison-1.jpg)
|
| 55 |
|
| 56 |
-
|
| 57 |
|
| 58 |
<details>
|
| 59 |
<summary>More multi-view examples</summary>
|
| 60 |
|
| 61 |
[](https://huggingface.co/hi3d-official/Hi3Dv1.0/resolve/main/assets/global-comparison-2.jpg)
|
| 62 |
|
| 63 |
-
Additional examples follow the same column order and rendering conventions as the preceding figure.
|
| 64 |
|
| 65 |
</details>
|
| 66 |
|
| 67 |
-
##
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 68 |
|
| 69 |
-
- **
|
| 70 |
-
- **
|
| 71 |
-
- **
|
| 72 |
-
- **Application-specific validation.** Visual detail and nominal resolution do not by themselves guarantee mesh suitability for a particular downstream workflow.
|
| 73 |
|
| 74 |
-
#
|
| 75 |
|
| 76 |
-
Hi3D
|
| 77 |
|
|
|
|
|
|
| 7 |
- geometry-refinement
|
| 8 |
- sparc3d
|
| 9 |
- image-to-3d
|
| 10 |
+
license: other
|
| 11 |
+
license_name: hi3d-open-license-agreement-1.0
|
| 12 |
+
license_link: LICENSE
|
| 13 |
---
|
| 14 |
|
| 15 |
# Hi3D v1.0
|
|
|
|
| 20 |
|
| 21 |
**[Live Demo](https://huggingface.co/spaces/ilcve21/Sparc3D)** · [GitHub Repository](https://github.com/hi3d-official/Hi3Dv1.0) · [International Website](http://hi3d.ai/) · [China Website](https://www.hi3d.cn/)
|
| 22 |
|
| 23 |
+
Released on October 23, 2026.
|
|
|
|
|
|
|
| 24 |
|
| 25 |
## Overview
|
| 26 |
|
| 27 |
+
Hi3D v1.0 refines a coarse mesh into high-resolution geometry, conditioned on a reference image of the same object. Built upon the Sparc3D representation and refinement architecture, it progressively samples sparse latents, decodes them with a self-pruning sparse VAE, and extracts a mesh.
|
| 28 |
+
|
| 29 |
+
The project report describes training on approximately **two million curated 3D assets** and refinement up to an effective sparse extraction-grid resolution of **1536³**. The Python package and public API retain the names `sparc3d` and `Sparc3DPipeline` for compatibility.
|
| 30 |
|
| 31 |
+
This repository provides the **Hi3D v1.0 refinement model artifacts**. Inference code is available in the [GitHub repository](https://github.com/hi3d-official/Hi3Dv1.0). Training code and the paper's evaluation harness are not included. Model artifacts are available on [Hugging Face](https://huggingface.co/hi3d-official/Hi3Dv1.0). The examples load `hi3d-official/Hi3Dv1.0` directly; a compatible local model directory is also supported.
|
| 32 |
|
| 33 |
## System overview
|
| 34 |
|
| 35 |
[](https://huggingface.co/hi3d-official/Hi3Dv1.0/resolve/main/assets/framework.png)
|
| 36 |
|
| 37 |
+
Image features condition sparse flow on coordinates derived from the coarse geometry. After decoding and mesh extraction, the mesh is revoxelized to provide the sparse support for the next pass.
|
| 38 |
|
| 39 |
+
| Pass | Nominal structural grid | Sparse extraction grid | Transformer |
|
| 40 |
+
| --- | --- | --- | --- |
|
| 41 |
+
| 1 | 64³ | 512³ | `transformer_512` |
|
| 42 |
+
| 2 | 128³ | 1024³ | `transformer_1024` |
|
| 43 |
+
| 3 | 192³ | 1536³ | `transformer_1024` |
|
| 44 |
|
| 45 |
+
A 512³ request runs one pass; 1024³ runs two; 1536³ runs all three. These labels describe nominal sparse coordinate and extraction grids, rather than a dense 1536³ latent tensor or a fixed triangle count. See [pipeline details](https://github.com/hi3d-official/Hi3Dv1.0/blob/main/docs/pipeline.md).
|
| 46 |
|
| 47 |
## Visual comparisons
|
| 48 |
|
|
|
|
| 56 |
|
| 57 |
[](https://huggingface.co/hi3d-official/Hi3Dv1.0/resolve/main/assets/global-comparison-1.jpg)
|
| 58 |
|
| 59 |
+
Four objects are shown from the front, back, and bottom. Results combine shaded geometry and colored surface-normal renderings; the color does not represent generated textures. Hidden views illustrate plausible completion, rather than exact reconstruction of unseen surfaces.
|
| 60 |
|
| 61 |
<details>
|
| 62 |
<summary>More multi-view examples</summary>
|
| 63 |
|
| 64 |
[](https://huggingface.co/hi3d-official/Hi3Dv1.0/resolve/main/assets/global-comparison-2.jpg)
|
| 65 |
|
| 66 |
+
Additional examples follow the same column order and rendering conventions as the preceding figure. Hi3D v1.0 remains the teal-highlighted rightmost column.
|
| 67 |
|
| 68 |
</details>
|
| 69 |
|
| 70 |
+
## Installation
|
| 71 |
+
|
| 72 |
+
Requirements: **Linux, Python 3.10, an NVIDIA GPU with compute capability 8.0 or newer, and a CUDA toolkit in the 12.0–12.5 range** matching the installed PyTorch build. There is no CPU inference path. The measured stack used Python 3.10.12, PyTorch 2.5.0+cu124, CUDA toolkit 12.4.131, and a **96 GB NVIDIA H20**. The 1536³ ladder has only been validated on that GPU; peak memory and feasibility on smaller cards have not been established.
|
| 73 |
+
|
| 74 |
+
Clone this repository, then run from its root in a Python 3.10 environment:
|
| 75 |
+
|
| 76 |
+
```bash
|
| 77 |
+
git clone https://github.com/hi3d-official/Hi3Dv1.0.git
|
| 78 |
+
cd Hi3Dv1.0
|
| 79 |
+
|
| 80 |
+
pip install torch==2.5.0+cu124 torchvision==0.20.0+cu124 \
|
| 81 |
+
--extra-index-url https://download.pytorch.org/whl/cu124
|
| 82 |
+
pip install packaging ninja psutil
|
| 83 |
+
pip install --no-build-isolation flash-attn==2.7.4.post1
|
| 84 |
+
pip install -c docker/constraints.txt -e ".[inference]"
|
| 85 |
+
```
|
| 86 |
+
|
| 87 |
+
The constraints preserve the measured kernel stack, including `spconv-cu120==2.3.6` and `flash-attn==2.7.4.post1`. Install `flash-attn` separately after PyTorch: its source build needs the installed torch and CUDA toolkit, with build isolation disabled. Triton mesh kernels compile at first use. This project is installed from source; no PyPI release or prebuilt project wheel is supplied.
|
| 88 |
+
|
| 89 |
+
For background removal in the demos, additionally install `pip install -c docker/constraints.txt -e ".[demo]"`. This extra installs `rembg`, not a coarse generator. See [installation](https://github.com/hi3d-official/Hi3Dv1.0/blob/main/docs/installation.md) for Docker, the complete verified stack, offline setup, and alternative CUDA/kernel builds. Other configurations have not been measured.
|
| 90 |
+
|
| 91 |
+
## Model artifacts
|
| 92 |
+
|
| 93 |
+
The [Hugging Face model repository](https://huggingface.co/hi3d-official/Hi3Dv1.0/tree/main) provides these eight runtime files at its root. A local copy must preserve this layout:
|
| 94 |
+
|
| 95 |
+
```text
|
| 96 |
+
model_index.json
|
| 97 |
+
scheduler/scheduler_config.json
|
| 98 |
+
vae/config.json
|
| 99 |
+
vae/model.safetensors
|
| 100 |
+
transformer_512/config.json
|
| 101 |
+
transformer_512/model.safetensors
|
| 102 |
+
transformer_1024/config.json
|
| 103 |
+
transformer_1024/model.safetensors
|
| 104 |
+
```
|
| 105 |
+
|
| 106 |
+
The loader consumes JSON and safetensors; it does not execute model-repository Python or unpickle checkpoints. It also accepts a Hugging Face model repository ID with the same artifact layout. Standard Hub loading defers the high-resolution transformer until needed; local directories must contain all files, and enabling sequential CPU offload materializes both transformers on the CPU.
|
| 107 |
+
|
| 108 |
+
The conditioning encoders, `facebook/dinov2-large` and `openai/clip-vit-large-patch14`, are loaded separately from Hugging Face on first use. They are not part of the model directory above. `--revision` selects the refinement artifact revision; `--cache-dir` points to the directory holding `models--*` trees, normally `$HF_HOME/hub`.
|
| 109 |
+
|
| 110 |
+
## Python API
|
| 111 |
+
|
| 112 |
+
```python
|
| 113 |
+
from PIL import Image
|
| 114 |
+
import trimesh
|
| 115 |
+
from sparc3d import Sparc3DPipeline
|
| 116 |
+
|
| 117 |
+
pipeline = Sparc3DPipeline.from_pretrained(
|
| 118 |
+
"hi3d-official/Hi3Dv1.0",
|
| 119 |
+
).to("cuda")
|
| 120 |
+
|
| 121 |
+
result = pipeline(
|
| 122 |
+
Image.open("input.png"),
|
| 123 |
+
trimesh.load("coarse.glb", force="mesh", process=False),
|
| 124 |
+
resolution=1024,
|
| 125 |
+
num_inference_steps=25,
|
| 126 |
+
seed=0,
|
| 127 |
+
)
|
| 128 |
+
result.mesh.export("refined.glb")
|
| 129 |
+
```
|
| 130 |
+
|
| 131 |
+
`result` is a `Sparc3DPipelineOutput` containing a geometry-only `trimesh.Trimesh` and the achieved `resolution`. Supported resolutions are **512, 1024, and 1536**, with 25 scheduler updates per pass by default. Supply `seed` or a local CPU `torch.Generator`, not both. For existing unique integer voxel coordinates shaped `[N, 3]`, the API also provides `pipeline.refine_voxels(image, voxel_coords, structure_resolution=64, resolution=1536, seed=0)`.
|
| 132 |
+
|
| 133 |
+
### Memory offload and progress
|
| 134 |
+
|
| 135 |
+
To reduce model residency on the GPU, enable Accelerate offload while the pipeline is still on the CPU:
|
| 136 |
+
|
| 137 |
+
```python
|
| 138 |
+
pipeline = Sparc3DPipeline.from_pretrained("hi3d-official/Hi3Dv1.0")
|
| 139 |
+
pipeline.enable_sequential_cpu_offload("cuda")
|
| 140 |
+
```
|
| 141 |
+
|
| 142 |
+
Use this instead of `.to("cuda")`; the two modes cannot be combined. Offload does not establish a minimum supported GPU memory size and does not eliminate decoded-feature memory costs.
|
| 143 |
+
|
| 144 |
+
Pass `progress_callback` to `from_pretrained` to receive a `Sparc3DProgressEvent` after every scheduler update:
|
| 145 |
+
|
| 146 |
+
```python
|
| 147 |
+
def report(event):
|
| 148 |
+
print(f"pass {event.pass_index + 1}/{event.num_passes} "
|
| 149 |
+
f"step {event.step}/{event.num_inference_steps}")
|
| 150 |
+
|
| 151 |
+
pipeline = Sparc3DPipeline.from_pretrained(
|
| 152 |
+
"hi3d-official/Hi3Dv1.0", progress_callback=report,
|
| 153 |
+
).to("cuda")
|
| 154 |
+
```
|
| 155 |
+
|
| 156 |
+
Decoding, extraction, and postprocessing do not emit scheduler progress events.
|
| 157 |
+
|
| 158 |
+
## Command line
|
| 159 |
+
|
| 160 |
+
Refine an existing coarse mesh without any Hunyuan dependency:
|
| 161 |
+
|
| 162 |
+
```bash
|
| 163 |
+
python demo/refine_mesh.py \
|
| 164 |
+
--model hi3d-official/Hi3Dv1.0 \
|
| 165 |
+
--image input.png --coarse-mesh coarse.glb --output refined.glb \
|
| 166 |
+
--resolution 1024 --num-inference-steps 25 --seed 0
|
| 167 |
+
```
|
| 168 |
+
|
| 169 |
+
Add `--sequential-cpu-offload` for model offload, or `--remove-background` after installing the demo extra. Background removal is opt-in; transparent cut-out inputs retain their alpha for subject framing.
|
| 170 |
+
|
| 171 |
+
For offline refinement, provide local copies of all three model components:
|
| 172 |
+
|
| 173 |
+
```bash
|
| 174 |
+
python demo/refine_mesh.py \
|
| 175 |
+
--model /path/to/hi3d-v1.0-model \
|
| 176 |
+
--image input.png --coarse-mesh coarse.glb --output refined.glb \
|
| 177 |
+
--local-files-only \
|
| 178 |
+
--dino-model /path/to/dinov2-large \
|
| 179 |
+
--clip-model /path/to/clip-vit-large-patch14
|
| 180 |
+
```
|
| 181 |
+
|
| 182 |
+
## Optional Hunyuan coarse-generation example
|
| 183 |
+
|
| 184 |
+
`demo/coarse_stage.py` is an optional adapter for **Hunyuan3D-2 mini**, using `tencent/Hunyuan3D-2mini` and its `hunyuan3d-dit-v2-mini-turbo` subfolder. `demo/image_to_mesh.py` calls this adapter before refinement. Hunyuan is used only to demonstrate an upstream coarse generator; it is neither a required dependency of the core library nor a required product integration. You can replace the adapter or supply your own coarse mesh to `demo/refine_mesh.py`, which has no Hunyuan import.
|
| 185 |
+
|
| 186 |
+
Install the [Hunyuan3D-2 code](https://github.com/Tencent-Hunyuan/Hunyuan3D-2) and obtain its weights separately before running:
|
| 187 |
+
|
| 188 |
+
```bash
|
| 189 |
+
python demo/image_to_mesh.py \
|
| 190 |
+
--model hi3d-official/Hi3Dv1.0 \
|
| 191 |
+
--image assets/example.png --output refined.glb \
|
| 192 |
+
--resolution 1024 --seed 0
|
| 193 |
+
```
|
| 194 |
+
|
| 195 |
+
The Hunyuan code and weights are third-party releases, not code or weights released or relicensed by Hi3D. Follow the [upstream source license](https://github.com/Tencent-Hunyuan/Hunyuan3D-2/blob/main/LICENSE) and the [Hunyuan3D-2 mini model license](https://huggingface.co/tencent/Hunyuan3D-2mini/blob/main/LICENSE). See [external models and optional examples](THIRD_PARTY_LICENSES.md#external-models-and-optional-examples) and the [coarse-stage installation notes](https://github.com/hi3d-official/Hi3Dv1.0/blob/main/docs/installation.md#the-coarse-stage).
|
| 196 |
+
|
| 197 |
+
`--coarse-model` and `--coarse-subfolder` override the coarse model. Offline end-to-end use additionally needs a local Hunyuan model: the refinement flags `--local-files-only`, `--revision`, and `--cache-dir` do not configure the Hunyuan loader.
|
| 198 |
+
|
| 199 |
+
## Scope and reproducibility
|
| 200 |
+
|
| 201 |
+
- **Geometry only, batch size one.** No textures, materials, or vertex colors are generated. Output is recentered and normalized to unit maximum radius, so input world coordinates and absolute scale are not preserved.
|
| 202 |
+
- **Coarse structure matters.** Severe structural errors in the coarse mesh can persist. Geometry hidden from the image is a plausible completion.
|
| 203 |
+
- **GPU kernels are required.** `flash-attn` has no fallback attention path. Adaptive voxelization may use a coarser support grid on complex inputs and emits a warning. A request that cannot reach the target resolution raises instead of silently returning a lower resolution.
|
| 204 |
+
- **Seeds are not mesh hashes.** The refinement sampler uses a local CPU RNG, but GPU sparse convolution and attention are not bitwise deterministic. Compare meshes geometrically using the same inputs, artifact, scheduler, and environment.
|
| 205 |
+
- **Inference validation only.** Training code, the evaluation harness, benchmark splits, and comparison meshes are not included; this repository alone cannot reproduce the paper's comparative tables. Geometric detail and nominal resolution do not guarantee fitness for a downstream application.
|
| 206 |
+
|
| 207 |
+
## Documentation
|
| 208 |
+
|
| 209 |
+
- [Installation](https://github.com/hi3d-official/Hi3Dv1.0/blob/main/docs/installation.md): verified stack, Docker, offline loading, and GPU dependencies.
|
| 210 |
+
- [Pipeline](https://github.com/hi3d-official/Hi3Dv1.0/blob/main/docs/pipeline.md): refinement passes, conditioning, extraction, and memory behavior.
|
| 211 |
+
- [Reproduction](https://github.com/hi3d-official/Hi3Dv1.0/blob/main/docs/reproduction.md): validation scope and meaningful run-to-run comparisons.
|
| 212 |
+
|
| 213 |
+
## License and acknowledgments
|
| 214 |
+
|
| 215 |
+
The Hi3D-owned or authorized portions of the second-stage implementation and modifications, documentation, configuration, and eight model artifact files identified in Schedule 2 are governed by the **[Hi3D Open License Agreement Version 1.0](LICENSE)**. See [license scope](THIRD_PARTY_LICENSES.md#license-scope) for the scope and exclusions; the Agreement controls.
|
| 216 |
|
| 217 |
+
- **Commercial use is permitted under the Agreement.** If a related product or service exceeds **200,000 monthly active users** or reaches **USD 1,000,000 in monthly revenue**, notify the Licensor and apply for a separate written license within **60 days**, subject to Section 5 and its aggregation and transition rules.
|
| 218 |
+
- **Commercial integrations must display `Powered by Hi3D 1.0`** as specified in Section 7, linking to the official website identified in Schedule 2 where supported. Distribution and use also remain subject to the Agreement's notice requirements and Acceptable Use Policy.
|
| 219 |
+
- **Standalone outputs have different treatment.** Obtaining, editing, displaying, selling, or distributing an output that contains no Hi3D Materials or Model Derivative does not by itself trigger the branding, Agreement/NOTICE distribution, or scale-license obligations. Applicable law and third-party rights still apply.
|
|
|
|
| 220 |
|
| 221 |
+
Existing **Apache-2.0 and MIT terms remain applicable to the original and third-party portions they cover**; those rights are not replaced by the Hi3D Agreement. The original Apache text is preserved in [THIRD_PARTY_LICENSES.md](THIRD_PARTY_LICENSES.md#original-apache-license). See [THIRD_PARTY_LICENSES.md](THIRD_PARTY_LICENSES.md), [NOTICE](NOTICE), and [AUTHORS](AUTHORS) for retained terms and attribution. The included Hunyuan adapter is distinct from the external Hunyuan implementation, weights, and outputs, which remain subject to their own terms, as do DINOv2 and CLIP.
|
| 222 |
|
| 223 |
+
For Hi3D license inquiries, contact [contact@hi3d.ai](mailto:contact@hi3d.ai).
|
| 224 |
|
| 225 |
+
Hi3D v1.0 builds upon [Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modeling](https://arxiv.org/abs/2505.14521). We acknowledge the original Sparc3D work and its upstream research.
|
README.zh-CN.md
CHANGED
|
@@ -1,34 +1,34 @@
|
|
| 1 |
# Hi3D v1.0
|
| 2 |
|
| 3 |
-
<a href="https://huggingface.co/hi3d-official/Hi3Dv1.0"><kbd>English</kbd></a> · **简体中文**
|
| 4 |
|
| 5 |
**基于 Sparc3D 的高分辨率 3D 几何细化模型。**
|
| 6 |
|
| 7 |
-
**[在线体验](https://huggingface.co/spaces/ilcve21/Sparc3D)** · [GitHub 仓库](https://github.com/hi3d-official/Hi3Dv1.0) · [国际官网](http://hi3d.ai/) · [国内官网](https://www.hi3d.cn/)
|
| 8 |
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
本 Hugging Face 仓库同步展示 [GitHub 官方项目](https://github.com/hi3d-official/Hi3Dv1.0)的预告内容,包含项目说明、系统框架与部分效果对比,尚未提供实际代码或模型权重。
|
| 12 |
|
| 13 |
## 项目介绍
|
| 14 |
|
| 15 |
-
Hi3D v1.0
|
|
|
|
|
|
|
| 16 |
|
| 17 |
-
|
| 18 |
|
| 19 |
## 系统框架
|
| 20 |
|
| 21 |
[](https://huggingface.co/hi3d-official/Hi3Dv1.0/resolve/main/assets/framework.png)
|
| 22 |
|
| 23 |
-
图像特征在粗几何所确定的稀疏坐标上为流模型提供条件
|
| 24 |
|
| 25 |
-
|
|
| 26 |
-
| --- | --- | --- |
|
| 27 |
-
| 1 | 64³ | 512³ |
|
| 28 |
-
| 2 | 128³ | 1024³ |
|
| 29 |
-
| 3 | 192³ | 1536³ |
|
| 30 |
|
| 31 |
-
以上数值表示标称稀疏坐标与
|
| 32 |
|
| 33 |
## 效果对比
|
| 34 |
|
|
@@ -42,24 +42,170 @@ Hi3D v1.0 是 Hi3D 官方推出的高分辨率 3D 几何细化项目。模型基
|
|
| 42 |
|
| 43 |
[](https://huggingface.co/hi3d-official/Hi3Dv1.0/resolve/main/assets/global-comparison-1.jpg)
|
| 44 |
|
| 45 |
-
四组物体分别展示正面、背面与底部视角。结果组合呈现灰模与彩色表面法线渲染,彩色部分不表示生成的纹理。
|
| 46 |
|
| 47 |
<details>
|
| 48 |
<summary>更多多视角示例</summary>
|
| 49 |
|
| 50 |
[](https://huggingface.co/hi3d-official/Hi3Dv1.0/resolve/main/assets/global-comparison-2.jpg)
|
| 51 |
|
| 52 |
-
更多示例沿用上一张图的列顺序与渲染方式。
|
| 53 |
|
| 54 |
</details>
|
| 55 |
|
| 56 |
-
##
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 57 |
|
| 58 |
-
|
| 59 |
-
- **依赖粗网格。** 上游粗网格提供整体结构,其中严重的结构错误可能在细化后保留。
|
| 60 |
-
- **遮挡区域。** 输入图不可见的几何属于合理补全,不能视为真实隐藏表面的精确重建。
|
| 61 |
-
- **按应用验证。** 视觉细节与标称分辨率本身不能保证网格满足特定下游工作流的要求。
|
| 62 |
|
| 63 |
-
|
| 64 |
|
| 65 |
-
Hi3D v1.0 基于 [Sparc3D](https://arxiv.org/abs/2505.14521) 构建,感谢原始 Sparc3D 工作及
|
|
|
|
| 1 |
# Hi3D v1.0
|
| 2 |
|
| 3 |
+
<a href="https://huggingface.co/hi3d-official/Hi3Dv1.0/blob/main/README.md"><kbd>English</kbd></a> · **简体中文**
|
| 4 |
|
| 5 |
**基于 Sparc3D 的高分辨率 3D 几何细化模型。**
|
| 6 |
|
| 7 |
+
**[在线体验](https://huggingface.co/spaces/ilcve21/Sparc3D)** · [GitHub 代码仓库](https://github.com/hi3d-official/Hi3Dv1.0) · [国际官网](http://hi3d.ai/) · [国内官网](https://www.hi3d.cn/)
|
| 8 |
|
| 9 |
+
已于 2026 年 10 月 23 日公开发布。
|
|
|
|
|
|
|
| 10 |
|
| 11 |
## 项目介绍
|
| 12 |
|
| 13 |
+
Hi3D v1.0 以同一物体的参考图和粗网格为输入,细化生成高分辨率几何。模型基于 Sparc3D 的表示与细化架构,逐级采样稀疏潜变量,通过自剪枝稀疏 VAE 解码并提取网格。
|
| 14 |
+
|
| 15 |
+
项目报告采用约 **200 万个精选 3D 资产**的训练规模,并支持最高 **1536³** 有效稀疏提取网格分辨率。为保持兼容,Python 包与公开 API 继续使用 `sparc3d` 和 `Sparc3DPipeline` 名称。
|
| 16 |
|
| 17 |
+
本仓库提供 **Hi3D v1.0 细化模型文件**;推理代码位于 [GitHub 仓库](https://github.com/hi3d-official/Hi3Dv1.0),不包含训练代码和论文评测工具。模型文件已发布至 [Hugging Face](https://huggingface.co/hi3d-official/Hi3Dv1.0)。示例直接加载 `hi3d-official/Hi3Dv1.0`,也支持传入兼容的本地模型目录。
|
| 18 |
|
| 19 |
## 系统框架
|
| 20 |
|
| 21 |
[](https://huggingface.co/hi3d-official/Hi3Dv1.0/resolve/main/assets/framework.png)
|
| 22 |
|
| 23 |
+
图像特征在粗几何所确定的稀疏坐标上为流模型提供条件。解码与网格提取后,重新体素化网格,形成下一轮的稀疏支撑。
|
| 24 |
|
| 25 |
+
| 轮次 | 标称结构网格 | 稀疏提取网格 | Transformer |
|
| 26 |
+
| --- | --- | --- | --- |
|
| 27 |
+
| 1 | 64³ | 512³ | `transformer_512` |
|
| 28 |
+
| 2 | 128³ | 1024³ | `transformer_1024` |
|
| 29 |
+
| 3 | 192³ | 1536³ | `transformer_1024` |
|
| 30 |
|
| 31 |
+
请求 512³ 时运行一轮,1024³ 运行两轮,1536³ 运行三轮。以上数值表示标称稀疏坐标与提取网格,并非稠密 1536³ 潜变量张量,也不表示固定的三角面数。详见[流程说明](https://github.com/hi3d-official/Hi3Dv1.0/blob/main/docs/pipeline.md)。
|
| 32 |
|
| 33 |
## 效果对比
|
| 34 |
|
|
|
|
| 42 |
|
| 43 |
[](https://huggingface.co/hi3d-official/Hi3Dv1.0/resolve/main/assets/global-comparison-1.jpg)
|
| 44 |
|
| 45 |
+
四组物体分别展示正面、背面与底部视角。结果组合呈现灰模与彩色表面法线渲染,彩色部分不表示生成的纹理。隐藏视角展示合理补全,不能视为真实不可见表面的精确重建。
|
| 46 |
|
| 47 |
<details>
|
| 48 |
<summary>更多多视角示例</summary>
|
| 49 |
|
| 50 |
[](https://huggingface.co/hi3d-official/Hi3Dv1.0/resolve/main/assets/global-comparison-2.jpg)
|
| 51 |
|
| 52 |
+
更多示例沿用上一张图的列顺序与渲染方式,Hi3D v1.0 仍为青绿色���出的最右列。
|
| 53 |
|
| 54 |
</details>
|
| 55 |
|
| 56 |
+
## 安装
|
| 57 |
+
|
| 58 |
+
环境要求:**Linux、Python 3.10、计算能力不低于 8.0 的 NVIDIA GPU,以及与所装 PyTorch 构建匹配的 CUDA 12.0–12.5 工具链**。不支持 CPU 推理。已实测组合为 Python 3.10.12、PyTorch 2.5.0+cu124、CUDA toolkit 12.4.131 和 **96 GB NVIDIA H20**。1536³ 完整流程仅在该 GPU 上验证,尚无更小显存卡的峰值内存或可用性结论。
|
| 59 |
+
|
| 60 |
+
克隆本仓库后,在仓库根目录、Python 3.10 环境中执行:
|
| 61 |
+
|
| 62 |
+
```bash
|
| 63 |
+
git clone https://github.com/hi3d-official/Hi3Dv1.0.git
|
| 64 |
+
cd Hi3Dv1.0
|
| 65 |
+
|
| 66 |
+
pip install torch==2.5.0+cu124 torchvision==0.20.0+cu124 \
|
| 67 |
+
--extra-index-url https://download.pytorch.org/whl/cu124
|
| 68 |
+
pip install packaging ninja psutil
|
| 69 |
+
pip install --no-build-isolation flash-attn==2.7.4.post1
|
| 70 |
+
pip install -c docker/constraints.txt -e ".[inference]"
|
| 71 |
+
```
|
| 72 |
+
|
| 73 |
+
约束文件保留已实测的内核组合,包括 `spconv-cu120==2.3.6` 与 `flash-attn==2.7.4.post1`。先安装 PyTorch,再单独安装 `flash-attn`:其源码构建需要已安装的 torch 和 CUDA toolkit,并需关闭构建隔离。Triton 网格内核在首次调用时编译。本项目从源码安装,未提供 PyPI 发行包或预编译项目 wheel。
|
| 74 |
+
|
| 75 |
+
需要演示脚本去背景功能时,另执行 `pip install -c docker/constraints.txt -e ".[demo]"`。该依赖组安装 `rembg`,不安装粗网格生成器。[安装文档](https://github.com/hi3d-official/Hi3Dv1.0/blob/main/docs/installation.md)提供 Docker、完整验证环境、离线配置与替代 CUDA/内核构建说明;其他配置尚未实测。
|
| 76 |
+
|
| 77 |
+
## 模型文件
|
| 78 |
+
|
| 79 |
+
[Hugging Face 模型仓库](https://huggingface.co/hi3d-official/Hi3Dv1.0/tree/main)根目录提供以下 8 个运行文件;下载到本地时请保持相同结构:
|
| 80 |
+
|
| 81 |
+
```text
|
| 82 |
+
model_index.json
|
| 83 |
+
scheduler/scheduler_config.json
|
| 84 |
+
vae/config.json
|
| 85 |
+
vae/model.safetensors
|
| 86 |
+
transformer_512/config.json
|
| 87 |
+
transformer_512/model.safetensors
|
| 88 |
+
transformer_1024/config.json
|
| 89 |
+
transformer_1024/model.safetensors
|
| 90 |
+
```
|
| 91 |
+
|
| 92 |
+
加载器读取 JSON 和 safetensors,不执行模型仓库中的 Python,也不反序列化 pickle checkpoint。也可传入具有相同文件结构的 Hugging Face 模型仓库 ID。普通 Hub 加载会延迟加载高分辨率 Transformer;本地目录必须具备全部文件,启用顺序 CPU 卸载时会在 CPU 上实例化两个 Transformer。
|
| 93 |
+
|
| 94 |
+
条件编码器 `facebook/dinov2-large` 和 `openai/clip-vit-large-patch14` 在首次使用时分别从 Hugging Face 加载,不包含在上述模型目录中。`--revision` 指定细化模型文件的版本;`--cache-dir` 指向存放 `models--*` 目录的位置,通常为 `$HF_HOME/hub`。
|
| 95 |
+
|
| 96 |
+
## Python API
|
| 97 |
+
|
| 98 |
+
```python
|
| 99 |
+
from PIL import Image
|
| 100 |
+
import trimesh
|
| 101 |
+
from sparc3d import Sparc3DPipeline
|
| 102 |
+
|
| 103 |
+
pipeline = Sparc3DPipeline.from_pretrained(
|
| 104 |
+
"hi3d-official/Hi3Dv1.0",
|
| 105 |
+
).to("cuda")
|
| 106 |
+
|
| 107 |
+
result = pipeline(
|
| 108 |
+
Image.open("input.png"),
|
| 109 |
+
trimesh.load("coarse.glb", force="mesh", process=False),
|
| 110 |
+
resolution=1024,
|
| 111 |
+
num_inference_steps=25,
|
| 112 |
+
seed=0,
|
| 113 |
+
)
|
| 114 |
+
result.mesh.export("refined.glb")
|
| 115 |
+
```
|
| 116 |
+
|
| 117 |
+
`result` 为 `Sparc3DPipelineOutput`,包含纯几何 `trimesh.Trimesh` 与实际生成的 `resolution`。支持 **512、1024、1536** 三档分辨率,默认每轮进行 25 次调度更新。`seed` 与本地 CPU `torch.Generator` 二选一。若已有形状为 `[N, 3]` 的唯一整数体素坐标,可使用 `pipeline.refine_voxels(image, voxel_coords, structure_resolution=64, resolution=1536, seed=0)`。
|
| 118 |
+
|
| 119 |
+
### 内存卸载与进度
|
| 120 |
+
|
| 121 |
+
要减少模型在 GPU 上的常驻内存,请在模型仍位于 CPU 时启用 Accelerate 卸载:
|
| 122 |
+
|
| 123 |
+
```python
|
| 124 |
+
pipeline = Sparc3DPipeline.from_pretrained("hi3d-official/Hi3Dv1.0")
|
| 125 |
+
pipeline.enable_sequential_cpu_offload("cuda")
|
| 126 |
+
```
|
| 127 |
+
|
| 128 |
+
该模式替代 `.to("cuda")`,两者不可混用。卸载功能不构成最低显存承诺,也不能消除解码特征的内存开销。
|
| 129 |
+
|
| 130 |
+
向 `from_pretrained` 传入 `progress_callback`,可在每次调度更新后收到 `Sparc3DProgressEvent`:
|
| 131 |
+
|
| 132 |
+
```python
|
| 133 |
+
def report(event):
|
| 134 |
+
print(f"pass {event.pass_index + 1}/{event.num_passes} "
|
| 135 |
+
f"step {event.step}/{event.num_inference_steps}")
|
| 136 |
+
|
| 137 |
+
pipeline = Sparc3DPipeline.from_pretrained(
|
| 138 |
+
"hi3d-official/Hi3Dv1.0", progress_callback=report,
|
| 139 |
+
).to("cuda")
|
| 140 |
+
```
|
| 141 |
+
|
| 142 |
+
解码、网格提取与后处理阶段不发送调度进度事件。
|
| 143 |
+
|
| 144 |
+
## 命令行
|
| 145 |
+
|
| 146 |
+
直接细化已有粗网格,无需 Hunyuan:
|
| 147 |
+
|
| 148 |
+
```bash
|
| 149 |
+
python demo/refine_mesh.py \
|
| 150 |
+
--model hi3d-official/Hi3Dv1.0 \
|
| 151 |
+
--image input.png --coarse-mesh coarse.glb --output refined.glb \
|
| 152 |
+
--resolution 1024 --num-inference-steps 25 --seed 0
|
| 153 |
+
```
|
| 154 |
+
|
| 155 |
+
可添加 `--sequential-cpu-offload` 启用模型卸载;安装演示依赖后,可添加 `--remove-background` 去除背景。去背景功能需主动启用,透明抠图的 alpha 通道会保留用于主体取景。
|
| 156 |
+
|
| 157 |
+
离线细化时,为三个模型组件提供本地副本:
|
| 158 |
+
|
| 159 |
+
```bash
|
| 160 |
+
python demo/refine_mesh.py \
|
| 161 |
+
--model /path/to/hi3d-v1.0-model \
|
| 162 |
+
--image input.png --coarse-mesh coarse.glb --output refined.glb \
|
| 163 |
+
--local-files-only \
|
| 164 |
+
--dino-model /path/to/dinov2-large \
|
| 165 |
+
--clip-model /path/to/clip-vit-large-patch14
|
| 166 |
+
```
|
| 167 |
+
|
| 168 |
+
## 可选 Hunyuan 粗网格生成示例
|
| 169 |
+
|
| 170 |
+
`demo/coarse_stage.py` 是 **Hunyuan3D-2 mini** 的可选适配器,使用 `tencent/Hunyuan3D-2mini` 及其 `hunyuan3d-dit-v2-mini-turbo` 子目录。`demo/image_to_mesh.py` 先调用该适配器,再运行细化。Hunyuan 仅用于演示一种上游粗网格生成方式,不是核心库的强制依赖,也不构成产品绑定。可替换适配器,或通过 `demo/refine_mesh.py` 直接提供自己的粗网格;后者没有 Hunyuan 导入。
|
| 171 |
+
|
| 172 |
+
运行前,需单独安装 [Hunyuan3D-2 代码](https://github.com/Tencent-Hunyuan/Hunyuan3D-2),并取得其权重:
|
| 173 |
+
|
| 174 |
+
```bash
|
| 175 |
+
python demo/image_to_mesh.py \
|
| 176 |
+
--model hi3d-official/Hi3Dv1.0 \
|
| 177 |
+
--image assets/example.png --output refined.glb \
|
| 178 |
+
--resolution 1024 --seed 0
|
| 179 |
+
```
|
| 180 |
+
|
| 181 |
+
Hunyuan 代码与权重属于第三方发行内容,并非由 Hi3D 开源或重新许可。请遵循[上游源码许可](https://github.com/Tencent-Hunyuan/Hunyuan3D-2/blob/main/LICENSE)与 [Hunyuan3D-2 mini 模型许可](https://huggingface.co/tencent/Hunyuan3D-2mini/blob/main/LICENSE),并参阅[外部模型与可选示例](THIRD_PARTY_LICENSES.md#external-models-and-optional-examples)和[粗网格阶段安装说明](https://github.com/hi3d-official/Hi3Dv1.0/blob/main/docs/installation.md#the-coarse-stage)。
|
| 182 |
+
|
| 183 |
+
`--coarse-model` 与 `--coarse-subfolder` 可覆盖默认粗模型。离线运行全流程还需要本地 Hunyuan 模型;细化阶段的 `--local-files-only`、`--revision` 与 `--cache-dir` 不会配置 Hunyuan 加载器。
|
| 184 |
+
|
| 185 |
+
## 适用范围与可复现性
|
| 186 |
+
|
| 187 |
+
- **仅几何、单样本。** 不生成纹理、材质或顶点颜色。输出会重新居中并将最大半径归一为 1,不保留输入的世界坐标和绝对尺度。
|
| 188 |
+
- **依赖粗结构。** 粗网格中的严重结构错误可能保留;图像不可见区域属于合理补全。
|
| 189 |
+
- **需要 GPU 内核。** `flash-attn` 没有替代注意力路径。复杂输入的自适应体素化可能采用更粗的支撑网格,并发出警告;无法达到请求分辨率时会报错,不会静默返回较低分辨率。
|
| 190 |
+
- **相同种子不保证相同网格哈希。** 细化采样器使用本地 CPU 随机数生成器,但 GPU 稀疏卷积与注意力并非逐位确定。请在相同输入、模型版本、调度器与环境下比较几何。
|
| 191 |
+
- **仅支持推理验证。** 未包含训练代码、评测工具、基准划分与对比网格,不能仅凭本仓库复现论文对比表格。几何细节与标称分辨率也不保证满足特定下游应用。
|
| 192 |
+
|
| 193 |
+
## 文档
|
| 194 |
+
|
| 195 |
+
- [安装](https://github.com/hi3d-official/Hi3Dv1.0/blob/main/docs/installation.md):已验证环境、Docker、离线加载与 GPU 依赖。
|
| 196 |
+
- [流程](https://github.com/hi3d-official/Hi3Dv1.0/blob/main/docs/pipeline.md):逐级细化、条件编码、网格提取与内存行为。
|
| 197 |
+
- [复现](https://github.com/hi3d-official/Hi3Dv1.0/blob/main/docs/reproduction.md):验证范围与有意义的运行间比较。
|
| 198 |
+
|
| 199 |
+
## 许可证与致谢
|
| 200 |
+
|
| 201 |
+
Schedule 2 列明的第二阶段实现与修改、文档、配置及八个模型文件中,Hi3D 自有或有权许可的部分适用 **[Hi3D Open License Agreement Version 1.0](LICENSE)**。范围与排除项见 [许可范围](THIRD_PARTY_LICENSES.md#license-scope),具体以协议正文为准。
|
| 202 |
+
|
| 203 |
+
- **协议允许商用。** 相关产品或服务的**月活用户超过 200,000**,或**月收入达到 1,000,000 美元**时,须在 **60 日内**通知许可方并申请单独书面许可,同时遵守第 5 条的合并计算与过渡规则。
|
| 204 |
+
- **商业集成须展示 `Powered by Hi3D 1.0`**,按第 7 条要求在支持链接的位置链接至 Schedule 2 指定的官网。分发和使用还须遵守协议中的声明要求与可接受使用政策。
|
| 205 |
+
- **纯输出适用不同规则。** 获取、编辑、展示、销售或分发不含 Hi3D Materials 或 Model Derivative 的输出,本身不触发上述品牌展示、随附协议/NOTICE 或规模许可义务;适用法律和第三方权利仍须遵守。
|
| 206 |
|
| 207 |
+
原有及第三方部分适用的 **Apache-2.0、MIT 条款继续有效**,其权利不被 Hi3D 协议替换。原 Apache 正文保留于 [THIRD_PARTY_LICENSES.md](THIRD_PARTY_LICENSES.md#original-apache-license),完整第三方条款与归属见 [THIRD_PARTY_LICENSES.md](THIRD_PARTY_LICENSES.md)、[NOTICE](NOTICE) 和 [AUTHORS](AUTHORS)。本仓库的 Hunyuan 适配示例与外部 Hunyuan 实现、权重及输出相区分,后者仍适用各自条款;DINOv2 与 CLIP 同样适用其自身条款。
|
|
|
|
|
|
|
|
|
|
| 208 |
|
| 209 |
+
Hi3D 许可相关咨询请联系 [contact@hi3d.ai](mailto:contact@hi3d.ai)。
|
| 210 |
|
| 211 |
+
Hi3D v1.0 基于 [Sparc3D: Sparse Representation and Construction for High-Resolution 3D Shapes Modeling](https://arxiv.org/abs/2505.14521) 构建,感谢原始 Sparc3D 工作及相关上游研究。
|
THIRD_PARTY_LICENSES.md
ADDED
|
@@ -0,0 +1,474 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Third-party licenses
|
| 2 |
+
|
| 3 |
+
This license index adapts the SPARC3D third-party notices for Hi3D v1.0. The
|
| 4 |
+
original license texts and attributions are retained, with additional references
|
| 5 |
+
for separately obtained models and optional examples.
|
| 6 |
+
|
| 7 |
+
The original SPARC3D license is retained in [Original Apache license](#original-apache-license).
|
| 8 |
+
Hi3D-owned or otherwise licensable materials identified in Schedule 2 are governed
|
| 9 |
+
by the Hi3D Agreement in [LICENSE](LICENSE). See [License scope](#license-scope)
|
| 10 |
+
for the component boundaries; the new Agreement does not replace original
|
| 11 |
+
third-party licenses or previously granted rights.
|
| 12 |
+
|
| 13 |
+
Parts of this package are derived from other open-source projects. Each is listed
|
| 14 |
+
below with the files it covers and the full text of its license, as those licenses
|
| 15 |
+
require. Every file named here also carries a provenance header pointing back to
|
| 16 |
+
this document.
|
| 17 |
+
|
| 18 |
+
| Upstream | License | Covers |
|
| 19 |
+
| --- | --- | --- |
|
| 20 |
+
| [Microsoft TRELLIS](https://github.com/microsoft/TRELLIS) | MIT | the sparse transformer and its building blocks |
|
| 21 |
+
| [Pointcept / Point Transformer V3](https://github.com/Pointcept/Pointcept) | MIT | the `Point` structure and the sparse PTv3 decoder |
|
| 22 |
+
| [O-CNN (ocnn-pytorch)](https://github.com/octree-nn/ocnn-pytorch) | MIT | Z-order (Morton) encoding |
|
| 23 |
+
| [NVIDIA FlexiCubes](https://github.com/nv-tlabs/FlexiCubes) | Apache-2.0 | dual-marching-cubes surface extraction |
|
| 24 |
+
|
| 25 |
+
---
|
| 26 |
+
|
| 27 |
+
## License scope
|
| 28 |
+
|
| 29 |
+
This index explains the component boundaries in Schedule 2 of the
|
| 30 |
+
[Hi3D Open License Agreement Version 1.0](LICENSE). It does not amend the
|
| 31 |
+
Agreement or grant additional rights. The Agreement and each applicable
|
| 32 |
+
third-party license govern their respective materials.
|
| 33 |
+
|
| 34 |
+
| Component | Applicable terms |
|
| 35 |
+
| --- | --- |
|
| 36 |
+
| Second-stage implementation and modifications in `sparc3d/`, including package initialization | The Hi3D Agreement applies only to content OCEANO HK HOLDING LIMITED owns or is authorized to license; original third-party rights in the same files remain under their original terms |
|
| 37 |
+
| `demo/refine_mesh.py`, `demo/image_to_mesh.py`, `demo/coarse_stage.py` | The Hi3D Agreement applies to licensable example code; Hunyuan's separate implementation, weights and outputs are excluded |
|
| 38 |
+
| The README, documentation and configuration paths listed in Schedule 2 | The Hi3D Agreement applies to licensable content; original notices and third-party terms remain in effect |
|
| 39 |
+
| The eight refinement artifacts listed in Schedule 2 | Distributed separately from the source code and Python packages under the Hi3D Agreement; other files or versions are not included merely by sharing a repository |
|
| 40 |
+
| Original SPARC3D, TRELLIS, Pointcept, O-CNN and FlexiCubes rights | Retained Apache-2.0 or MIT terms, as detailed in this file and the original source headers |
|
| 41 |
+
| Hunyuan3D-2mini, DINOv2, CLIP and other external dependencies | Their own upstream licenses; not relicensed by Hi3D |
|
| 42 |
+
| The five files listed as Sample Media in Schedule 2 | Excluded from the Hi3D Agreement; their presence or display does not grant reuse rights |
|
| 43 |
+
| Unreleased first-stage materials, training code, datasets, and brand assets | Excluded, subject to the limited trademark permissions expressly granted in the Agreement |
|
| 44 |
+
|
| 45 |
+
`LicenseRef-Hi3D-1.0` denotes the custom Agreement in [LICENSE](LICENSE), not a
|
| 46 |
+
blanket license for every file. Previously granted rights under applicable
|
| 47 |
+
Apache-2.0 or MIT licenses are not withdrawn or replaced by the Hi3D Agreement.
|
| 48 |
+
|
| 49 |
+
The source archive contains media expressly excluded by Schedule 2. Therefore
|
| 50 |
+
its package metadata does not assert a single SPDX license expression for the
|
| 51 |
+
whole archive. The complete applicable agreements and notices are included with
|
| 52 |
+
the Python distributions.
|
| 53 |
+
|
| 54 |
+
---
|
| 55 |
+
|
| 56 |
+
## Microsoft TRELLIS
|
| 57 |
+
|
| 58 |
+
Covers:
|
| 59 |
+
|
| 60 |
+
- `sparc3d/models/transformers/sparc3d_transformer.py`
|
| 61 |
+
- `sparc3d/nn/norm.py`
|
| 62 |
+
- `sparc3d/nn/rope.py`
|
| 63 |
+
- `sparc3d/nn/utils.py`
|
| 64 |
+
- `sparc3d/nn/sparse/basic.py`
|
| 65 |
+
- `sparc3d/nn/sparse/conv.py`
|
| 66 |
+
- `sparc3d/nn/sparse/linear.py`
|
| 67 |
+
- `sparc3d/nn/sparse/nonlinearity.py`
|
| 68 |
+
- `sparc3d/nn/sparse/spatial.py`
|
| 69 |
+
- `sparc3d/nn/sparse/attention/full_attn.py`
|
| 70 |
+
- `sparc3d/nn/sparse/attention/modules.py`
|
| 71 |
+
- `sparc3d/nn/sparse/transformer/blocks.py`
|
| 72 |
+
- `sparc3d/nn/sparse/transformer/modulated.py`
|
| 73 |
+
|
| 74 |
+
Each of these files states the specific SPARC3D modification in its header. In
|
| 75 |
+
general the training paths, the alternative attention backends, and the dense
|
| 76 |
+
variants were removed, leaving the released inference architecture.
|
| 77 |
+
|
| 78 |
+
```
|
| 79 |
+
MIT License
|
| 80 |
+
|
| 81 |
+
Copyright (c) Microsoft Corporation.
|
| 82 |
+
|
| 83 |
+
Permission is hereby granted, free of charge, to any person obtaining a copy
|
| 84 |
+
of this software and associated documentation files (the "Software"), to deal
|
| 85 |
+
in the Software without restriction, including without limitation the rights
|
| 86 |
+
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
| 87 |
+
copies of the Software, and to permit persons to whom the Software is
|
| 88 |
+
furnished to do so, subject to the following conditions:
|
| 89 |
+
|
| 90 |
+
The above copyright notice and this permission notice shall be included in all
|
| 91 |
+
copies or substantial portions of the Software.
|
| 92 |
+
|
| 93 |
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
| 94 |
+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
| 95 |
+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
| 96 |
+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
| 97 |
+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
| 98 |
+
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
| 99 |
+
SOFTWARE
|
| 100 |
+
```
|
| 101 |
+
|
| 102 |
+
---
|
| 103 |
+
|
| 104 |
+
## Pointcept / Point Transformer V3
|
| 105 |
+
|
| 106 |
+
Point Transformer V3 (Xiaoyang Wu et al.) is released as part of Pointcept.
|
| 107 |
+
|
| 108 |
+
Covers:
|
| 109 |
+
|
| 110 |
+
- `sparc3d/models/autoencoders/blocks.py`
|
| 111 |
+
- `sparc3d/models/autoencoders/ptv3.py`
|
| 112 |
+
- `sparc3d/structures/point.py`
|
| 113 |
+
- `sparc3d/structures/point_modules.py`
|
| 114 |
+
- `sparc3d/utils/misc.py`
|
| 115 |
+
- `sparc3d/utils/precision.py`
|
| 116 |
+
- `sparc3d/utils/serialization/default.py`
|
| 117 |
+
|
| 118 |
+
The decoder half was specialized for the sparse mesh autoencoder; the encoder,
|
| 119 |
+
the training paths, and the Hilbert serialization order were removed.
|
| 120 |
+
|
| 121 |
+
```
|
| 122 |
+
MIT License
|
| 123 |
+
|
| 124 |
+
Copyright (c) 2023 Pointcept
|
| 125 |
+
|
| 126 |
+
Permission is hereby granted, free of charge, to any person obtaining a copy
|
| 127 |
+
of this software and associated documentation files (the "Software"), to deal
|
| 128 |
+
in the Software without restriction, including without limitation the rights
|
| 129 |
+
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
| 130 |
+
copies of the Software, and to permit persons to whom the Software is
|
| 131 |
+
furnished to do so, subject to the following conditions:
|
| 132 |
+
|
| 133 |
+
The above copyright notice and this permission notice shall be included in all
|
| 134 |
+
copies or substantial portions of the Software.
|
| 135 |
+
|
| 136 |
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
| 137 |
+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
| 138 |
+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
| 139 |
+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
| 140 |
+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
| 141 |
+
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
| 142 |
+
SOFTWARE.
|
| 143 |
+
```
|
| 144 |
+
|
| 145 |
+
---
|
| 146 |
+
|
| 147 |
+
## O-CNN (ocnn-pytorch)
|
| 148 |
+
|
| 149 |
+
Covers:
|
| 150 |
+
|
| 151 |
+
- `sparc3d/utils/serialization/z_order.py`
|
| 152 |
+
|
| 153 |
+
The Morton decode tables and the batch-index field of the key were removed; only
|
| 154 |
+
`xyz2key` encoding is retained.
|
| 155 |
+
|
| 156 |
+
```
|
| 157 |
+
MIT License
|
| 158 |
+
|
| 159 |
+
Copyright (c) 2022 Peng-Shuai Wang <wangps@hotmail.com>
|
| 160 |
+
|
| 161 |
+
Permission is hereby granted, free of charge, to any person obtaining a copy
|
| 162 |
+
of this software and associated documentation files (the "Software"), to deal
|
| 163 |
+
in the Software without restriction, including without limitation the rights
|
| 164 |
+
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
| 165 |
+
copies of the Software, and to permit persons to whom the Software is
|
| 166 |
+
furnished to do so, subject to the following conditions:
|
| 167 |
+
|
| 168 |
+
The above copyright notice and this permission notice shall be included in
|
| 169 |
+
all copies or substantial portions of the Software.
|
| 170 |
+
|
| 171 |
+
THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
| 172 |
+
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
| 173 |
+
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
| 174 |
+
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
| 175 |
+
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
| 176 |
+
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN
|
| 177 |
+
THE SOFTWARE.
|
| 178 |
+
```
|
| 179 |
+
|
| 180 |
+
---
|
| 181 |
+
|
| 182 |
+
## NVIDIA FlexiCubes
|
| 183 |
+
|
| 184 |
+
Covers:
|
| 185 |
+
|
| 186 |
+
- `sparc3d/ops/flexicubes/`
|
| 187 |
+
|
| 188 |
+
FlexiCubes retains its Apache-2.0 license. Its copy of the
|
| 189 |
+
license ships in the package at `sparc3d/ops/flexicubes/LICENSE.txt`, satisfying
|
| 190 |
+
Apache-2.0 section 4(a); the NVIDIA copyright notices are retained in the source
|
| 191 |
+
files, satisfying 4(c); and `sparc3d/ops/flexicubes/flexicubes.py` carries a
|
| 192 |
+
header enumerating every SPARC3D modification, satisfying 4(b). Upstream ships no
|
| 193 |
+
`NOTICE` file, so 4(d) does not apply.
|
| 194 |
+
|
| 195 |
+
The vendored copy is inference-only: the tetrahedral output, the learned
|
| 196 |
+
interpolation weights, the developability regularizer, and the gradient hooks
|
| 197 |
+
were removed.
|
| 198 |
+
|
| 199 |
+
|
| 200 |
+
---
|
| 201 |
+
|
| 202 |
+
## External models and optional examples
|
| 203 |
+
|
| 204 |
+
This section indexes components obtained separately at runtime or by the user.
|
| 205 |
+
It does not add their code or weights to this distribution, grant a license to
|
| 206 |
+
them, or replace their upstream terms. Neither the Hi3D Agreement nor a retained
|
| 207 |
+
source-code license automatically applies to external model weights or
|
| 208 |
+
third-party outputs.
|
| 209 |
+
|
| 210 |
+
### Required external image encoders
|
| 211 |
+
|
| 212 |
+
The default image conditioner loads the following models separately. Neither is
|
| 213 |
+
included in the Hi3D refinement checkpoint or in this source tree.
|
| 214 |
+
|
| 215 |
+
| Component | Role | Official model source | Upstream license reference |
|
| 216 |
+
| --- | --- | --- | --- |
|
| 217 |
+
| DINOv2-large | Spatial image features | [facebook/dinov2-large](https://huggingface.co/facebook/dinov2-large) | [Apache-2.0, DINOv2 LICENSE](https://github.com/facebookresearch/dinov2/blob/main/LICENSE) |
|
| 218 |
+
| CLIP ViT-L/14 | Global image conditioning | [openai/clip-vit-large-patch14](https://huggingface.co/openai/clip-vit-large-patch14) | [MIT, CLIP LICENSE](https://github.com/openai/CLIP/blob/main/LICENSE) |
|
| 219 |
+
|
| 220 |
+
Consult each model's own model card and the terms supplied with the version you
|
| 221 |
+
obtain. Background-removal models used by the optional `rembg` integration are
|
| 222 |
+
also obtained separately and retain their own terms.
|
| 223 |
+
|
| 224 |
+
### Optional Hunyuan3D coarse-mesh example
|
| 225 |
+
|
| 226 |
+
`demo/coarse_stage.py` is a Hi3D / SPARC3D example adapter. It imports
|
| 227 |
+
`hy3dgen.shapegen.Hunyuan3DDiTFlowMatchingPipeline` only when that example is used.
|
| 228 |
+
Its default model is `tencent/Hunyuan3D-2mini`, subfolder
|
| 229 |
+
`hunyuan3d-dit-v2-mini-turbo`.
|
| 230 |
+
|
| 231 |
+
**Hunyuan3D is only an optional example of coarse-mesh generation.** It is not a
|
| 232 |
+
mandatory dependency of the Hi3D refinement library or a required product
|
| 233 |
+
integration. `demo/refine_mesh.py` and the core `sparc3d` package accept a supplied
|
| 234 |
+
coarse mesh without using Hunyuan3D. Other suitable coarse-mesh generators can be
|
| 235 |
+
used instead. Installing the `[inference]` or `[demo]` extras does not install
|
| 236 |
+
Hunyuan3D.
|
| 237 |
+
|
| 238 |
+
**Tencent's Hunyuan3D implementation and pretrained weights are third-party
|
| 239 |
+
releases, not open-source content released by Hi3D.** They are not bundled with
|
| 240 |
+
this repository and are not relicensed under the Hi3D Agreement or any
|
| 241 |
+
retained source-code license. Users who
|
| 242 |
+
choose this example obtain them separately and comply with their upstream terms.
|
| 243 |
+
|
| 244 |
+
| Component used by the example | Official source | Applicable upstream agreement |
|
| 245 |
+
| --- | --- | --- |
|
| 246 |
+
| Hunyuan3D-2 implementation (`hy3dgen`) | [Tencent-Hunyuan/Hunyuan3D-2](https://github.com/Tencent-Hunyuan/Hunyuan3D-2) | [Tencent Hunyuan 3D 2.0 Community License Agreement — source LICENSE](https://github.com/Tencent-Hunyuan/Hunyuan3D-2/blob/main/LICENSE) |
|
| 247 |
+
| Hunyuan3D-2mini weights, mini-turbo variant | [tencent/Hunyuan3D-2mini](https://huggingface.co/tencent/Hunyuan3D-2mini) | [Tencent Hunyuan 3D 2.0 Community License Agreement — model LICENSE](https://huggingface.co/tencent/Hunyuan3D-2mini/blob/main/LICENSE) |
|
| 248 |
+
|
| 249 |
+
Upstream license terms are version-specific. If you select a different model,
|
| 250 |
+
subfolder, or source version, consult its matching license and model card.
|
| 251 |
+
Example-only use does not waive applicable restrictions, attribution,
|
| 252 |
+
redistribution, or hosted-service obligations in those agreements.
|
| 253 |
+
|
| 254 |
+
### Hi3D refinement weights
|
| 255 |
+
|
| 256 |
+
The eight Hi3D refinement artifacts identified and released under Schedule 2
|
| 257 |
+
are governed by the Hi3D Agreement in [LICENSE](LICENSE). They are distributed
|
| 258 |
+
separately from this source repository; see [License scope](#license-scope).
|
| 259 |
+
Other model files are not covered merely because they share the repository or
|
| 260 |
+
use a similar name.
|
| 261 |
+
|
| 262 |
+
|
| 263 |
+
---
|
| 264 |
+
|
| 265 |
+
## Original Apache license
|
| 266 |
+
|
| 267 |
+
The following is the original SPARC3D Apache-2.0 text, retained without changes.
|
| 268 |
+
It continues to govern the materials and rights to which it originally applied;
|
| 269 |
+
the Hi3D Agreement does not revoke those grants.
|
| 270 |
+
|
| 271 |
+
```text
|
| 272 |
+
|
| 273 |
+
Apache License
|
| 274 |
+
Version 2.0, January 2004
|
| 275 |
+
http://www.apache.org/licenses/
|
| 276 |
+
|
| 277 |
+
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
|
| 278 |
+
|
| 279 |
+
1. Definitions.
|
| 280 |
+
|
| 281 |
+
"License" shall mean the terms and conditions for use, reproduction,
|
| 282 |
+
and distribution as defined by Sections 1 through 9 of this document.
|
| 283 |
+
|
| 284 |
+
"Licensor" shall mean the copyright owner or entity authorized by
|
| 285 |
+
the copyright owner that is granting the License.
|
| 286 |
+
|
| 287 |
+
"Legal Entity" shall mean the union of the acting entity and all
|
| 288 |
+
other entities that control, are controlled by, or are under common
|
| 289 |
+
control with that entity. For the purposes of this definition,
|
| 290 |
+
"control" means (i) the power, direct or indirect, to cause the
|
| 291 |
+
direction or management of such entity, whether by contract or
|
| 292 |
+
otherwise, or (ii) ownership of fifty percent (50%) or more of the
|
| 293 |
+
outstanding shares, or (iii) beneficial ownership of such entity.
|
| 294 |
+
|
| 295 |
+
"You" (or "Your") shall mean an individual or Legal Entity
|
| 296 |
+
exercising permissions granted by this License.
|
| 297 |
+
|
| 298 |
+
"Source" form shall mean the preferred form for making modifications,
|
| 299 |
+
including but not limited to software source code, documentation
|
| 300 |
+
source, and configuration files.
|
| 301 |
+
|
| 302 |
+
"Object" form shall mean any form resulting from mechanical
|
| 303 |
+
transformation or translation of a Source form, including but
|
| 304 |
+
not limited to compiled object code, generated documentation,
|
| 305 |
+
and conversions to other media types.
|
| 306 |
+
|
| 307 |
+
"Work" shall mean the work of authorship, whether in Source or
|
| 308 |
+
Object form, made available under the License, as indicated by a
|
| 309 |
+
copyright notice that is included in or attached to the work
|
| 310 |
+
(an example is provided in the Appendix below).
|
| 311 |
+
|
| 312 |
+
"Derivative Works" shall mean any work, whether in Source or Object
|
| 313 |
+
form, that is based on (or derived from) the Work and for which the
|
| 314 |
+
editorial revisions, annotations, elaborations, or other modifications
|
| 315 |
+
represent, as a whole, an original work of authorship. For the purposes
|
| 316 |
+
of this License, Derivative Works shall not include works that remain
|
| 317 |
+
separable from, or merely link (or bind by name) to the interfaces of,
|
| 318 |
+
the Work and Derivative Works thereof.
|
| 319 |
+
|
| 320 |
+
"Contribution" shall mean any work of authorship, including
|
| 321 |
+
the original version of the Work and any modifications or additions
|
| 322 |
+
to that Work or Derivative Works thereof, that is intentionally
|
| 323 |
+
submitted to Licensor for inclusion in the Work by the copyright owner
|
| 324 |
+
or by an individual or Legal Entity authorized to submit on behalf of
|
| 325 |
+
the copyright owner. For the purposes of this definition, "submitted"
|
| 326 |
+
means any form of electronic, verbal, or written communication sent
|
| 327 |
+
to the Licensor or its representatives, including but not limited to
|
| 328 |
+
communication on electronic mailing lists, source code control systems,
|
| 329 |
+
and issue tracking systems that are managed by, or on behalf of, the
|
| 330 |
+
Licensor for the purpose of discussing and improving the Work, but
|
| 331 |
+
excluding communication that is conspicuously marked or otherwise
|
| 332 |
+
designated in writing by the copyright owner as "Not a Contribution."
|
| 333 |
+
|
| 334 |
+
"Contributor" shall mean Licensor and any individual or Legal Entity
|
| 335 |
+
on behalf of whom a Contribution has been received by Licensor and
|
| 336 |
+
subsequently incorporated within the Work.
|
| 337 |
+
|
| 338 |
+
2. Grant of Copyright License. Subject to the terms and conditions of
|
| 339 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 340 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 341 |
+
copyright license to reproduce, prepare Derivative Works of,
|
| 342 |
+
publicly display, publicly perform, sublicense, and distribute the
|
| 343 |
+
Work and such Derivative Works in Source or Object form.
|
| 344 |
+
|
| 345 |
+
3. Grant of Patent License. Subject to the terms and conditions of
|
| 346 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 347 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 348 |
+
(except as stated in this section) patent license to make, have made,
|
| 349 |
+
use, offer to sell, sell, import, and otherwise transfer the Work,
|
| 350 |
+
where such license applies only to those patent claims licensable
|
| 351 |
+
by such Contributor that are necessarily infringed by their
|
| 352 |
+
Contribution(s) alone or by combination of their Contribution(s)
|
| 353 |
+
with the Work to which such Contribution(s) was submitted. If You
|
| 354 |
+
institute patent litigation against any entity (including a
|
| 355 |
+
cross-claim or counterclaim in a lawsuit) alleging that the Work
|
| 356 |
+
or a Contribution incorporated within the Work constitutes direct
|
| 357 |
+
or contributory patent infringement, then any patent licenses
|
| 358 |
+
granted to You under this License for that Work shall terminate
|
| 359 |
+
as of the date such litigation is filed.
|
| 360 |
+
|
| 361 |
+
4. Redistribution. You may reproduce and distribute copies of the
|
| 362 |
+
Work or Derivative Works thereof in any medium, with or without
|
| 363 |
+
modifications, and in Source or Object form, provided that You
|
| 364 |
+
meet the following conditions:
|
| 365 |
+
|
| 366 |
+
(a) You must give any other recipients of the Work or
|
| 367 |
+
Derivative Works a copy of this License; and
|
| 368 |
+
|
| 369 |
+
(b) You must cause any modified files to carry prominent notices
|
| 370 |
+
stating that You changed the files; and
|
| 371 |
+
|
| 372 |
+
(c) You must retain, in the Source form of any Derivative Works
|
| 373 |
+
that You distribute, all copyright, patent, trademark, and
|
| 374 |
+
attribution notices from the Source form of the Work,
|
| 375 |
+
excluding those notices that do not pertain to any part of
|
| 376 |
+
the Derivative Works; and
|
| 377 |
+
|
| 378 |
+
(d) If the Work includes a "NOTICE" text file as part of its
|
| 379 |
+
distribution, then any Derivative Works that You distribute must
|
| 380 |
+
include a readable copy of the attribution notices contained
|
| 381 |
+
within such NOTICE file, excluding those notices that do not
|
| 382 |
+
pertain to any part of the Derivative Works, in at least one
|
| 383 |
+
of the following places: within a NOTICE text file distributed
|
| 384 |
+
as part of the Derivative Works; within the Source form or
|
| 385 |
+
documentation, if provided along with the Derivative Works; or,
|
| 386 |
+
within a display generated by the Derivative Works, if and
|
| 387 |
+
wherever such third-party notices normally appear. The contents
|
| 388 |
+
of the NOTICE file are for informational purposes only and
|
| 389 |
+
do not modify the License. You may add Your own attribution
|
| 390 |
+
notices within Derivative Works that You distribute, alongside
|
| 391 |
+
or as an addendum to the NOTICE text from the Work, provided
|
| 392 |
+
that such additional attribution notices cannot be construed
|
| 393 |
+
as modifying the License.
|
| 394 |
+
|
| 395 |
+
You may add Your own copyright statement to Your modifications and
|
| 396 |
+
may provide additional or different license terms and conditions
|
| 397 |
+
for use, reproduction, or distribution of Your modifications, or
|
| 398 |
+
for any such Derivative Works as a whole, provided Your use,
|
| 399 |
+
reproduction, and distribution of the Work otherwise complies with
|
| 400 |
+
the conditions stated in this License.
|
| 401 |
+
|
| 402 |
+
5. Submission of Contributions. Unless You explicitly state otherwise,
|
| 403 |
+
any Contribution intentionally submitted for inclusion in the Work
|
| 404 |
+
by You to the Licensor shall be under the terms and conditions of
|
| 405 |
+
this License, without any additional terms or conditions.
|
| 406 |
+
Notwithstanding the above, nothing herein shall supersede or modify
|
| 407 |
+
the terms of any separate license agreement you may have executed
|
| 408 |
+
with Licensor regarding such Contributions.
|
| 409 |
+
|
| 410 |
+
6. Trademarks. This License does not grant permission to use the trade
|
| 411 |
+
names, trademarks, service marks, or product names of the Licensor,
|
| 412 |
+
except as required for reasonable and customary use in describing the
|
| 413 |
+
origin of the Work and reproducing the content of the NOTICE file.
|
| 414 |
+
|
| 415 |
+
7. Disclaimer of Warranty. Unless required by applicable law or
|
| 416 |
+
agreed to in writing, Licensor provides the Work (and each
|
| 417 |
+
Contributor provides its Contributions) on an "AS IS" BASIS,
|
| 418 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
| 419 |
+
implied, including, without limitation, any warranties or conditions
|
| 420 |
+
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
|
| 421 |
+
PARTICULAR PURPOSE. You are solely responsible for determining the
|
| 422 |
+
appropriateness of using or redistributing the Work and assume any
|
| 423 |
+
risks associated with Your exercise of permissions under this License.
|
| 424 |
+
|
| 425 |
+
8. Limitation of Liability. In no event and under no legal theory,
|
| 426 |
+
whether in tort (including negligence), contract, or otherwise,
|
| 427 |
+
unless required by applicable law (such as deliberate and grossly
|
| 428 |
+
negligent acts) or agreed to in writing, shall any Contributor be
|
| 429 |
+
liable to You for damages, including any direct, indirect, special,
|
| 430 |
+
incidental, or consequential damages of any character arising as a
|
| 431 |
+
result of this License or out of the use or inability to use the
|
| 432 |
+
Work (including but not limited to damages for loss of goodwill,
|
| 433 |
+
work stoppage, computer failure or malfunction, or any and all
|
| 434 |
+
other commercial damages or losses), even if such Contributor
|
| 435 |
+
has been advised of the possibility of such damages.
|
| 436 |
+
|
| 437 |
+
9. Accepting Warranty or Additional Liability. While redistributing
|
| 438 |
+
the Work or Derivative Works thereof, You may choose to offer,
|
| 439 |
+
and charge a fee for, acceptance of support, warranty, indemnity,
|
| 440 |
+
or other liability obligations and/or rights consistent with this
|
| 441 |
+
License. However, in accepting such obligations, You may act only
|
| 442 |
+
on Your own behalf and on Your sole responsibility, not on behalf
|
| 443 |
+
of any other Contributor, and only if You agree to indemnify,
|
| 444 |
+
defend, and hold each Contributor harmless for any liability
|
| 445 |
+
incurred by, or claims asserted against, such Contributor by reason
|
| 446 |
+
of your accepting any such warranty or additional liability.
|
| 447 |
+
|
| 448 |
+
END OF TERMS AND CONDITIONS
|
| 449 |
+
|
| 450 |
+
APPENDIX: How to apply the Apache License to your work.
|
| 451 |
+
|
| 452 |
+
To apply the Apache License to your work, attach the following
|
| 453 |
+
boilerplate notice, with the fields enclosed by brackets "[]"
|
| 454 |
+
replaced with your own identifying information. (Don't include
|
| 455 |
+
the brackets!) The text should be enclosed in the appropriate
|
| 456 |
+
comment syntax for the file format. We also recommend that a
|
| 457 |
+
file or class name and description of purpose be included on the
|
| 458 |
+
same "printed page" as the copyright notice for easier
|
| 459 |
+
identification within third-party archives.
|
| 460 |
+
|
| 461 |
+
Copyright 2026 The SPARC3D Authors
|
| 462 |
+
|
| 463 |
+
Licensed under the Apache License, Version 2.0 (the "License");
|
| 464 |
+
you may not use this file except in compliance with the License.
|
| 465 |
+
You may obtain a copy of the License at
|
| 466 |
+
|
| 467 |
+
http://www.apache.org/licenses/LICENSE-2.0
|
| 468 |
+
|
| 469 |
+
Unless required by applicable law or agreed to in writing, software
|
| 470 |
+
distributed under the License is distributed on an "AS IS" BASIS,
|
| 471 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
| 472 |
+
See the License for the specific language governing permissions and
|
| 473 |
+
limitations under the License.
|
| 474 |
+
```
|
model_index.json
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"_class_name": "Sparc3DPipeline",
|
| 3 |
+
"_format_version": "1.0",
|
| 4 |
+
"_sparc3d_version": "0.1.0",
|
| 5 |
+
"scheduler": "scheduler",
|
| 6 |
+
"vae": "vae",
|
| 7 |
+
"transformer_512": "transformer_512",
|
| 8 |
+
"transformer_1024": "transformer_1024"
|
| 9 |
+
}
|
scheduler/scheduler_config.json
ADDED
|
@@ -0,0 +1,6 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"_class_name": "FlowMatchHeunScheduler",
|
| 3 |
+
"num_inference_steps": 25,
|
| 4 |
+
"sigma_min": 0.002,
|
| 5 |
+
"time_rescale_factor": 2.0
|
| 6 |
+
}
|
sparc3d/ops/flexicubes/LICENSE.txt
ADDED
|
@@ -0,0 +1,202 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
Apache License
|
| 3 |
+
Version 2.0, January 2004
|
| 4 |
+
http://www.apache.org/licenses/
|
| 5 |
+
|
| 6 |
+
TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION
|
| 7 |
+
|
| 8 |
+
1. Definitions.
|
| 9 |
+
|
| 10 |
+
"License" shall mean the terms and conditions for use, reproduction,
|
| 11 |
+
and distribution as defined by Sections 1 through 9 of this document.
|
| 12 |
+
|
| 13 |
+
"Licensor" shall mean the copyright owner or entity authorized by
|
| 14 |
+
the copyright owner that is granting the License.
|
| 15 |
+
|
| 16 |
+
"Legal Entity" shall mean the union of the acting entity and all
|
| 17 |
+
other entities that control, are controlled by, or are under common
|
| 18 |
+
control with that entity. For the purposes of this definition,
|
| 19 |
+
"control" means (i) the power, direct or indirect, to cause the
|
| 20 |
+
direction or management of such entity, whether by contract or
|
| 21 |
+
otherwise, or (ii) ownership of fifty percent (50%) or more of the
|
| 22 |
+
outstanding shares, or (iii) beneficial ownership of such entity.
|
| 23 |
+
|
| 24 |
+
"You" (or "Your") shall mean an individual or Legal Entity
|
| 25 |
+
exercising permissions granted by this License.
|
| 26 |
+
|
| 27 |
+
"Source" form shall mean the preferred form for making modifications,
|
| 28 |
+
including but not limited to software source code, documentation
|
| 29 |
+
source, and configuration files.
|
| 30 |
+
|
| 31 |
+
"Object" form shall mean any form resulting from mechanical
|
| 32 |
+
transformation or translation of a Source form, including but
|
| 33 |
+
not limited to compiled object code, generated documentation,
|
| 34 |
+
and conversions to other media types.
|
| 35 |
+
|
| 36 |
+
"Work" shall mean the work of authorship, whether in Source or
|
| 37 |
+
Object form, made available under the License, as indicated by a
|
| 38 |
+
copyright notice that is included in or attached to the work
|
| 39 |
+
(an example is provided in the Appendix below).
|
| 40 |
+
|
| 41 |
+
"Derivative Works" shall mean any work, whether in Source or Object
|
| 42 |
+
form, that is based on (or derived from) the Work and for which the
|
| 43 |
+
editorial revisions, annotations, elaborations, or other modifications
|
| 44 |
+
represent, as a whole, an original work of authorship. For the purposes
|
| 45 |
+
of this License, Derivative Works shall not include works that remain
|
| 46 |
+
separable from, or merely link (or bind by name) to the interfaces of,
|
| 47 |
+
the Work and Derivative Works thereof.
|
| 48 |
+
|
| 49 |
+
"Contribution" shall mean any work of authorship, including
|
| 50 |
+
the original version of the Work and any modifications or additions
|
| 51 |
+
to that Work or Derivative Works thereof, that is intentionally
|
| 52 |
+
submitted to Licensor for inclusion in the Work by the copyright owner
|
| 53 |
+
or by an individual or Legal Entity authorized to submit on behalf of
|
| 54 |
+
the copyright owner. For the purposes of this definition, "submitted"
|
| 55 |
+
means any form of electronic, verbal, or written communication sent
|
| 56 |
+
to the Licensor or its representatives, including but not limited to
|
| 57 |
+
communication on electronic mailing lists, source code control systems,
|
| 58 |
+
and issue tracking systems that are managed by, or on behalf of, the
|
| 59 |
+
Licensor for the purpose of discussing and improving the Work, but
|
| 60 |
+
excluding communication that is conspicuously marked or otherwise
|
| 61 |
+
designated in writing by the copyright owner as "Not a Contribution."
|
| 62 |
+
|
| 63 |
+
"Contributor" shall mean Licensor and any individual or Legal Entity
|
| 64 |
+
on behalf of whom a Contribution has been received by Licensor and
|
| 65 |
+
subsequently incorporated within the Work.
|
| 66 |
+
|
| 67 |
+
2. Grant of Copyright License. Subject to the terms and conditions of
|
| 68 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 69 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 70 |
+
copyright license to reproduce, prepare Derivative Works of,
|
| 71 |
+
publicly display, publicly perform, sublicense, and distribute the
|
| 72 |
+
Work and such Derivative Works in Source or Object form.
|
| 73 |
+
|
| 74 |
+
3. Grant of Patent License. Subject to the terms and conditions of
|
| 75 |
+
this License, each Contributor hereby grants to You a perpetual,
|
| 76 |
+
worldwide, non-exclusive, no-charge, royalty-free, irrevocable
|
| 77 |
+
(except as stated in this section) patent license to make, have made,
|
| 78 |
+
use, offer to sell, sell, import, and otherwise transfer the Work,
|
| 79 |
+
where such license applies only to those patent claims licensable
|
| 80 |
+
by such Contributor that are necessarily infringed by their
|
| 81 |
+
Contribution(s) alone or by combination of their Contribution(s)
|
| 82 |
+
with the Work to which such Contribution(s) was submitted. If You
|
| 83 |
+
institute patent litigation against any entity (including a
|
| 84 |
+
cross-claim or counterclaim in a lawsuit) alleging that the Work
|
| 85 |
+
or a Contribution incorporated within the Work constitutes direct
|
| 86 |
+
or contributory patent infringement, then any patent licenses
|
| 87 |
+
granted to You under this License for that Work shall terminate
|
| 88 |
+
as of the date such litigation is filed.
|
| 89 |
+
|
| 90 |
+
4. Redistribution. You may reproduce and distribute copies of the
|
| 91 |
+
Work or Derivative Works thereof in any medium, with or without
|
| 92 |
+
modifications, and in Source or Object form, provided that You
|
| 93 |
+
meet the following conditions:
|
| 94 |
+
|
| 95 |
+
(a) You must give any other recipients of the Work or
|
| 96 |
+
Derivative Works a copy of this License; and
|
| 97 |
+
|
| 98 |
+
(b) You must cause any modified files to carry prominent notices
|
| 99 |
+
stating that You changed the files; and
|
| 100 |
+
|
| 101 |
+
(c) You must retain, in the Source form of any Derivative Works
|
| 102 |
+
that You distribute, all copyright, patent, trademark, and
|
| 103 |
+
attribution notices from the Source form of the Work,
|
| 104 |
+
excluding those notices that do not pertain to any part of
|
| 105 |
+
the Derivative Works; and
|
| 106 |
+
|
| 107 |
+
(d) If the Work includes a "NOTICE" text file as part of its
|
| 108 |
+
distribution, then any Derivative Works that You distribute must
|
| 109 |
+
include a readable copy of the attribution notices contained
|
| 110 |
+
within such NOTICE file, excluding those notices that do not
|
| 111 |
+
pertain to any part of the Derivative Works, in at least one
|
| 112 |
+
of the following places: within a NOTICE text file distributed
|
| 113 |
+
as part of the Derivative Works; within the Source form or
|
| 114 |
+
documentation, if provided along with the Derivative Works; or,
|
| 115 |
+
within a display generated by the Derivative Works, if and
|
| 116 |
+
wherever such third-party notices normally appear. The contents
|
| 117 |
+
of the NOTICE file are for informational purposes only and
|
| 118 |
+
do not modify the License. You may add Your own attribution
|
| 119 |
+
notices within Derivative Works that You distribute, alongside
|
| 120 |
+
or as an addendum to the NOTICE text from the Work, provided
|
| 121 |
+
that such additional attribution notices cannot be construed
|
| 122 |
+
as modifying the License.
|
| 123 |
+
|
| 124 |
+
You may add Your own copyright statement to Your modifications and
|
| 125 |
+
may provide additional or different license terms and conditions
|
| 126 |
+
for use, reproduction, or distribution of Your modifications, or
|
| 127 |
+
for any such Derivative Works as a whole, provided Your use,
|
| 128 |
+
reproduction, and distribution of the Work otherwise complies with
|
| 129 |
+
the conditions stated in this License.
|
| 130 |
+
|
| 131 |
+
5. Submission of Contributions. Unless You explicitly state otherwise,
|
| 132 |
+
any Contribution intentionally submitted for inclusion in the Work
|
| 133 |
+
by You to the Licensor shall be under the terms and conditions of
|
| 134 |
+
this License, without any additional terms or conditions.
|
| 135 |
+
Notwithstanding the above, nothing herein shall supersede or modify
|
| 136 |
+
the terms of any separate license agreement you may have executed
|
| 137 |
+
with Licensor regarding such Contributions.
|
| 138 |
+
|
| 139 |
+
6. Trademarks. This License does not grant permission to use the trade
|
| 140 |
+
names, trademarks, service marks, or product names of the Licensor,
|
| 141 |
+
except as required for reasonable and customary use in describing the
|
| 142 |
+
origin of the Work and reproducing the content of the NOTICE file.
|
| 143 |
+
|
| 144 |
+
7. Disclaimer of Warranty. Unless required by applicable law or
|
| 145 |
+
agreed to in writing, Licensor provides the Work (and each
|
| 146 |
+
Contributor provides its Contributions) on an "AS IS" BASIS,
|
| 147 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
|
| 148 |
+
implied, including, without limitation, any warranties or conditions
|
| 149 |
+
of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A
|
| 150 |
+
PARTICULAR PURPOSE. You are solely responsible for determining the
|
| 151 |
+
appropriateness of using or redistributing the Work and assume any
|
| 152 |
+
risks associated with Your exercise of permissions under this License.
|
| 153 |
+
|
| 154 |
+
8. Limitation of Liability. In no event and under no legal theory,
|
| 155 |
+
whether in tort (including negligence), contract, or otherwise,
|
| 156 |
+
unless required by applicable law (such as deliberate and grossly
|
| 157 |
+
negligent acts) or agreed to in writing, shall any Contributor be
|
| 158 |
+
liable to You for damages, including any direct, indirect, special,
|
| 159 |
+
incidental, or consequential damages of any character arising as a
|
| 160 |
+
result of this License or out of the use or inability to use the
|
| 161 |
+
Work (including but not limited to damages for loss of goodwill,
|
| 162 |
+
work stoppage, computer failure or malfunction, or any and all
|
| 163 |
+
other commercial damages or losses), even if such Contributor
|
| 164 |
+
has been advised of the possibility of such damages.
|
| 165 |
+
|
| 166 |
+
9. Accepting Warranty or Additional Liability. While redistributing
|
| 167 |
+
the Work or Derivative Works thereof, You may choose to offer,
|
| 168 |
+
and charge a fee for, acceptance of support, warranty, indemnity,
|
| 169 |
+
or other liability obligations and/or rights consistent with this
|
| 170 |
+
License. However, in accepting such obligations, You may act only
|
| 171 |
+
on Your own behalf and on Your sole responsibility, not on behalf
|
| 172 |
+
of any other Contributor, and only if You agree to indemnify,
|
| 173 |
+
defend, and hold each Contributor harmless for any liability
|
| 174 |
+
incurred by, or claims asserted against, such Contributor by reason
|
| 175 |
+
of your accepting any such warranty or additional liability.
|
| 176 |
+
|
| 177 |
+
END OF TERMS AND CONDITIONS
|
| 178 |
+
|
| 179 |
+
APPENDIX: How to apply the Apache License to your work.
|
| 180 |
+
|
| 181 |
+
To apply the Apache License to your work, attach the following
|
| 182 |
+
boilerplate notice, with the fields enclosed by brackets "[]"
|
| 183 |
+
replaced with your own identifying information. (Don't include
|
| 184 |
+
the brackets!) The text should be enclosed in the appropriate
|
| 185 |
+
comment syntax for the file format. We also recommend that a
|
| 186 |
+
file or class name and description of purpose be included on the
|
| 187 |
+
same "printed page" as the copyright notice for easier
|
| 188 |
+
identification within third-party archives.
|
| 189 |
+
|
| 190 |
+
Copyright [yyyy] [name of copyright owner]
|
| 191 |
+
|
| 192 |
+
Licensed under the Apache License, Version 2.0 (the "License");
|
| 193 |
+
you may not use this file except in compliance with the License.
|
| 194 |
+
You may obtain a copy of the License at
|
| 195 |
+
|
| 196 |
+
http://www.apache.org/licenses/LICENSE-2.0
|
| 197 |
+
|
| 198 |
+
Unless required by applicable law or agreed to in writing, software
|
| 199 |
+
distributed under the License is distributed on an "AS IS" BASIS,
|
| 200 |
+
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
|
| 201 |
+
See the License for the specific language governing permissions and
|
| 202 |
+
limitations under the License.
|
transformer_1024/config.json
ADDED
|
@@ -0,0 +1,84 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"resolution": 128,
|
| 3 |
+
"in_channels": 32,
|
| 4 |
+
"out_channels": 32,
|
| 5 |
+
"model_channels": 2112,
|
| 6 |
+
"cond_channels": 2048,
|
| 7 |
+
"num_blocks": 24,
|
| 8 |
+
"num_heads": 22,
|
| 9 |
+
"mlp_ratio": 4.0,
|
| 10 |
+
"patch_size": 2,
|
| 11 |
+
"num_io_res_blocks": 2,
|
| 12 |
+
"io_block_channels": [
|
| 13 |
+
256
|
| 14 |
+
],
|
| 15 |
+
"use_fp16": true,
|
| 16 |
+
"latent_mean": [
|
| 17 |
+
-0.00155994,
|
| 18 |
+
0.03314649,
|
| 19 |
+
-0.00307796,
|
| 20 |
+
0.00630751,
|
| 21 |
+
-0.00835457,
|
| 22 |
+
-0.03860179,
|
| 23 |
+
0.02528263,
|
| 24 |
+
0.0374062,
|
| 25 |
+
-0.06209833,
|
| 26 |
+
-0.00539356,
|
| 27 |
+
-0.02110271,
|
| 28 |
+
0.05126001,
|
| 29 |
+
0.00753371,
|
| 30 |
+
0.02866821,
|
| 31 |
+
0.02772475,
|
| 32 |
+
-0.02131735,
|
| 33 |
+
-0.02799912,
|
| 34 |
+
0.01084617,
|
| 35 |
+
0.03433723,
|
| 36 |
+
-0.009031,
|
| 37 |
+
-0.00121899,
|
| 38 |
+
-0.01944244,
|
| 39 |
+
0.01641873,
|
| 40 |
+
-0.01063657,
|
| 41 |
+
-0.01990618,
|
| 42 |
+
0.04856062,
|
| 43 |
+
0.01747232,
|
| 44 |
+
-0.02387775,
|
| 45 |
+
0.03216169,
|
| 46 |
+
-0.03732105,
|
| 47 |
+
-0.03730354,
|
| 48 |
+
-0.01948937
|
| 49 |
+
],
|
| 50 |
+
"latent_std": [
|
| 51 |
+
0.61686146,
|
| 52 |
+
0.8011532,
|
| 53 |
+
0.854892,
|
| 54 |
+
0.96384716,
|
| 55 |
+
0.7700591,
|
| 56 |
+
0.6285985,
|
| 57 |
+
0.61541015,
|
| 58 |
+
0.7436831,
|
| 59 |
+
0.6276261,
|
| 60 |
+
1.0184228,
|
| 61 |
+
0.77113867,
|
| 62 |
+
0.6262799,
|
| 63 |
+
0.68749195,
|
| 64 |
+
0.62698966,
|
| 65 |
+
0.7549124,
|
| 66 |
+
0.615774,
|
| 67 |
+
0.6378066,
|
| 68 |
+
0.80406,
|
| 69 |
+
0.83846325,
|
| 70 |
+
0.6912039,
|
| 71 |
+
0.6922758,
|
| 72 |
+
0.79321617,
|
| 73 |
+
0.6347593,
|
| 74 |
+
0.638483,
|
| 75 |
+
0.67194235,
|
| 76 |
+
0.7351938,
|
| 77 |
+
0.84781533,
|
| 78 |
+
0.9301291,
|
| 79 |
+
0.6269144,
|
| 80 |
+
0.6790608,
|
| 81 |
+
0.6519877,
|
| 82 |
+
0.7769204
|
| 83 |
+
]
|
| 84 |
+
}
|
transformer_1024/model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a2ca5e44dde51cacecd59b42fceeb5f14e75d55e6dd047337752c4e6f281008c
|
| 3 |
+
size 3675679280
|
transformer_512/config.json
ADDED
|
@@ -0,0 +1,84 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"resolution": 64,
|
| 3 |
+
"in_channels": 32,
|
| 4 |
+
"out_channels": 32,
|
| 5 |
+
"model_channels": 2112,
|
| 6 |
+
"cond_channels": 2048,
|
| 7 |
+
"num_blocks": 24,
|
| 8 |
+
"num_heads": 22,
|
| 9 |
+
"mlp_ratio": 4.0,
|
| 10 |
+
"patch_size": 2,
|
| 11 |
+
"num_io_res_blocks": 2,
|
| 12 |
+
"io_block_channels": [
|
| 13 |
+
256
|
| 14 |
+
],
|
| 15 |
+
"use_fp16": true,
|
| 16 |
+
"latent_mean": [
|
| 17 |
+
-0.00155994,
|
| 18 |
+
0.03314649,
|
| 19 |
+
-0.00307796,
|
| 20 |
+
0.00630751,
|
| 21 |
+
-0.00835457,
|
| 22 |
+
-0.03860179,
|
| 23 |
+
0.02528263,
|
| 24 |
+
0.0374062,
|
| 25 |
+
-0.06209833,
|
| 26 |
+
-0.00539356,
|
| 27 |
+
-0.02110271,
|
| 28 |
+
0.05126001,
|
| 29 |
+
0.00753371,
|
| 30 |
+
0.02866821,
|
| 31 |
+
0.02772475,
|
| 32 |
+
-0.02131735,
|
| 33 |
+
-0.02799912,
|
| 34 |
+
0.01084617,
|
| 35 |
+
0.03433723,
|
| 36 |
+
-0.009031,
|
| 37 |
+
-0.00121899,
|
| 38 |
+
-0.01944244,
|
| 39 |
+
0.01641873,
|
| 40 |
+
-0.01063657,
|
| 41 |
+
-0.01990618,
|
| 42 |
+
0.04856062,
|
| 43 |
+
0.01747232,
|
| 44 |
+
-0.02387775,
|
| 45 |
+
0.03216169,
|
| 46 |
+
-0.03732105,
|
| 47 |
+
-0.03730354,
|
| 48 |
+
-0.01948937
|
| 49 |
+
],
|
| 50 |
+
"latent_std": [
|
| 51 |
+
0.61686146,
|
| 52 |
+
0.8011532,
|
| 53 |
+
0.854892,
|
| 54 |
+
0.96384716,
|
| 55 |
+
0.7700591,
|
| 56 |
+
0.6285985,
|
| 57 |
+
0.61541015,
|
| 58 |
+
0.7436831,
|
| 59 |
+
0.6276261,
|
| 60 |
+
1.0184228,
|
| 61 |
+
0.77113867,
|
| 62 |
+
0.6262799,
|
| 63 |
+
0.68749195,
|
| 64 |
+
0.62698966,
|
| 65 |
+
0.7549124,
|
| 66 |
+
0.615774,
|
| 67 |
+
0.6378066,
|
| 68 |
+
0.80406,
|
| 69 |
+
0.83846325,
|
| 70 |
+
0.6912039,
|
| 71 |
+
0.6922758,
|
| 72 |
+
0.79321617,
|
| 73 |
+
0.6347593,
|
| 74 |
+
0.638483,
|
| 75 |
+
0.67194235,
|
| 76 |
+
0.7351938,
|
| 77 |
+
0.84781533,
|
| 78 |
+
0.9301291,
|
| 79 |
+
0.6269144,
|
| 80 |
+
0.6790608,
|
| 81 |
+
0.6519877,
|
| 82 |
+
0.7769204
|
| 83 |
+
]
|
| 84 |
+
}
|
transformer_512/model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8ba88311dccf23463c6e10dd0d3bd5e0c5c35d1608c6f466413b6428b5ad8e56
|
| 3 |
+
size 3675679280
|
vae/config.json
ADDED
|
@@ -0,0 +1,9 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
{
|
| 2 |
+
"model": {
|
| 3 |
+
"type": "SparconvVAE",
|
| 4 |
+
"decoder_cfg": {
|
| 5 |
+
"type": "PTv3MeshDecoder",
|
| 6 |
+
"z_channels": 32
|
| 7 |
+
}
|
| 8 |
+
}
|
| 9 |
+
}
|
vae/model.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:605d207c77f8db0b33c567a5861252f0090cf3c3604dfda1cfee09e8f0b53f3e
|
| 3 |
+
size 376629712
|