-
Mesh Simplification For Unfolding
Authors:
Manas Bhargava,
Camille Schreck,
Marco Freire,
Pierre-Alexandre Hugron,
Sylvain Lefebvre,
Silvia Sellán,
Bernd Bickel
Abstract:
We present a computational approach for unfolding 3D shapes isometrically into the plane as a single patch without overlapping triangles. This is a hard, sometimes impossible, problem, which existing methods are forced to soften by allowing for map distortions or multiple patches. Instead, we propose a geometric relaxation of the problem: we modify the input shape until it admits an overlap-free u…
▽ More
We present a computational approach for unfolding 3D shapes isometrically into the plane as a single patch without overlapping triangles. This is a hard, sometimes impossible, problem, which existing methods are forced to soften by allowing for map distortions or multiple patches. Instead, we propose a geometric relaxation of the problem: we modify the input shape until it admits an overlap-free unfolding. We achieve this by locally displacing vertices and collapsing edges, guided by the unfolding process. We validate our algorithm quantitatively and qualitatively on a large dataset of complex shapes and show its proficiency by fabricating real shapes from paper.
△ Less
Submitted 13 August, 2024;
originally announced August 2024.
-
QuickCurve: revisiting slightly non-planar 3D printing
Authors:
Emilio Ottonello,
Pierre-Alexandre Hugron,
Alberto Parmiggiani,
Sylvain Lefebvre
Abstract:
Additive manufacturing builds physical objects by accumulating layers upon layers of solidified material. This process is typically done with horizontal planar layers. However, fused filament printers have the capability to extrude material along 3D curves. The idea of depositing out-of-plane, also known as non-planar printing, has spawned a trend of research towards algorithms that could generate…
▽ More
Additive manufacturing builds physical objects by accumulating layers upon layers of solidified material. This process is typically done with horizontal planar layers. However, fused filament printers have the capability to extrude material along 3D curves. The idea of depositing out-of-plane, also known as non-planar printing, has spawned a trend of research towards algorithms that could generate non-planar deposition paths automatically from a 3D object. In this paper we introduce a novel algorithm for this purpose. Our method optimizes for a curved slicing surface. This surface is intersected with the input model to extract non-planar layers, with the objective of accurately reproducing the model top surfaces while avoiding collisions. Our formulation leads to a simple and efficient approach that only requires solving for a single least-square problem. Notably, it does not require a tetrahedralization of the input or iterative solver passes, while being more general than simpler approaches. We further explore how to orient the paths to follow the principal curvatures of the surfaces, how to filter spurious tiny features damaging the results, and how to achieve a good compromise of mixing planar and non-planar strategies within the same part. We present a complete formulation and its implementation, and demonstrate our method on a variety of 3D printed models.
△ Less
Submitted 6 June, 2024;
originally announced June 2024.
-
$\textit{A Contrario}$ Paradigm for YOLO-based Infrared Small Target Detection
Authors:
Alina Ciocarlan,
Sylvie Le Hégarat-Mascle,
Sidonie Lefebvre,
Arnaud Woiselle,
Clara Barbanson
Abstract:
Detecting small to tiny targets in infrared images is a challenging task in computer vision, especially when it comes to differentiating these targets from noisy or textured backgrounds. Traditional object detection methods such as YOLO struggle to detect tiny objects compared to segmentation neural networks, resulting in weaker performance when detecting small targets. To reduce the number of fal…
▽ More
Detecting small to tiny targets in infrared images is a challenging task in computer vision, especially when it comes to differentiating these targets from noisy or textured backgrounds. Traditional object detection methods such as YOLO struggle to detect tiny objects compared to segmentation neural networks, resulting in weaker performance when detecting small targets. To reduce the number of false alarms while maintaining a high detection rate, we introduce an $\textit{a contrario}$ decision criterion into the training of a YOLO detector. The latter takes advantage of the $\textit{unexpectedness}$ of small targets to discriminate them from complex backgrounds. Adding this statistical criterion to a YOLOv7-tiny bridges the performance gap between state-of-the-art segmentation methods for infrared small target detection and object detection networks. It also significantly increases the robustness of YOLO towards few-shot settings.
△ Less
Submitted 3 February, 2024;
originally announced February 2024.
-
Deep-NFA: a Deep $\textit{a contrario}$ Framework for Small Object Detection
Authors:
Alina Ciocarlan,
Sylvie Le Hegarat-Mascle,
Sidonie Lefebvre,
Arnaud Woiselle
Abstract:
The detection of small objects is a challenging task in computer vision. Conventional object detection methods have difficulty in finding the balance between high detection and low false alarm rates. In the literature, some methods have addressed this issue by enhancing the feature map responses, but without guaranteeing robustness with respect to the number of false alarms induced by background e…
▽ More
The detection of small objects is a challenging task in computer vision. Conventional object detection methods have difficulty in finding the balance between high detection and low false alarm rates. In the literature, some methods have addressed this issue by enhancing the feature map responses, but without guaranteeing robustness with respect to the number of false alarms induced by background elements. To tackle this problem, we introduce an $\textit{a contrario}$ decision criterion into the learning process to take into account the unexpectedness of small objects. This statistic criterion enhances the feature map responses while controlling the number of false alarms (NFA) and can be integrated into any semantic segmentation neural network. Our add-on NFA module not only allows us to obtain competitive results for small target and crack detection tasks respectively, but also leads to more robust and interpretable results.
△ Less
Submitted 2 March, 2023;
originally announced March 2023.
-
A statistically constrained internal method for single image super-resolution
Authors:
Pierrick Chatillon,
Yann Gousseau,
Sidonie Lefebvre
Abstract:
Deep learning based methods for single-image super-resolution (SR) have drawn a lot of attention lately. In particular, various papers have shown that the learning stage can be performed on a single image, resulting in the so-called internal approaches. The SinGAN method is one of these contributions, where the distribution of image patches is learnt on the image at hand and propagated at finer sc…
▽ More
Deep learning based methods for single-image super-resolution (SR) have drawn a lot of attention lately. In particular, various papers have shown that the learning stage can be performed on a single image, resulting in the so-called internal approaches. The SinGAN method is one of these contributions, where the distribution of image patches is learnt on the image at hand and propagated at finer scales. Now, there are situations where some statistical a priori can be assumed for the final image. In particular, many natural phenomena yield images having power law Fourier spectrum, such as clouds and other texture images. In this work, we show how such a priori information can be integrated into an internal super-resolution approach, by constraining the learned up-sampling procedure of SinGAN. We consider various types of constraints, related to the Fourier power spectrum, the color histograms and the consistency of the upsampling scheme. We demonstrate on various experiments that these constraints are indeed satisfied, but also that some perceptual quality measures can be improved by the proposed approach.
△ Less
Submitted 3 February, 2023;
originally announced February 2023.
-
A geometrically aware auto-encoder for multi-texture synthesis
Authors:
Pierrick Chatillon,
Yann Gousseau,
Sidonie Lefebvre
Abstract:
We propose an auto-encoder architecture for multi-texture synthesis. The approach relies on both a compact encoder accounting for second order neural statistics and a generator incorporating adaptive periodic content. Images are embedded in a compact and geometrically consistent latent space, where the texture representation and its spatial organisation are disentangled. Texture synthesis and inte…
▽ More
We propose an auto-encoder architecture for multi-texture synthesis. The approach relies on both a compact encoder accounting for second order neural statistics and a generator incorporating adaptive periodic content. Images are embedded in a compact and geometrically consistent latent space, where the texture representation and its spatial organisation are disentangled. Texture synthesis and interpolation tasks can be performed directly from these latent codes. Our experiments demonstrate that our model outperforms state-of-the-art feed-forward methods in terms of visual quality and various texture related metrics.
△ Less
Submitted 29 June, 2023; v1 submitted 3 February, 2023;
originally announced February 2023.
-
Détection de petites cibles par apprentissage profond et critère a contrario
Authors:
Alina Ciocarlan,
Sylvie Le Hegarat-Mascle,
Sidonie Lefebvre,
Clara Barbanson
Abstract:
Small target detection is an essential yet challenging task in defense applications, since differentiating low-contrast targets from natural textured and noisy environment remains difficult. To better take into account the contextual information, we propose to explore deep learning approaches based on attention mechanisms. Specifically, we propose a customized version of TransUnet including channe…
▽ More
Small target detection is an essential yet challenging task in defense applications, since differentiating low-contrast targets from natural textured and noisy environment remains difficult. To better take into account the contextual information, we propose to explore deep learning approaches based on attention mechanisms. Specifically, we propose a customized version of TransUnet including channel attention, which has shown a significant improvement in performance. Moreover, the lack of annotated data induces weak detection precision, leading to many false alarms. We thus explore a contrario methods in order to select meaningful potential targets detected by a weak deep learning training.
--
La détection de petites cibles est une problématique délicate mais essentielle dans le domaine de la défense, notamment lorsqu'il s'agit de différencier ces cibles d'un fond bruité ou texturé, ou lorsqu'elles sont de faible contraste. Pour mieux prendre en compte les informations contextuelles, nous proposons d'explorer différentes approches de segmentation par apprentissage profond, dont certaines basées sur les mécanismes d'attention. Nous proposons également d'inclure un module d'attention par canal au TransUnet, réseau à l'état de l'art, ce qui permet d'améliorer significativement les performances. Par ailleurs, le manque de données annotées induit une perte en précision lors des détections, conduisant à de nombreuses fausses alarmes non pertinentes. Nous explorons donc des méthodes a contrario afin de sélectionner les cibles les plus significatives détectées par un réseau entraîné avec peu de données.
△ Less
Submitted 3 October, 2022;
originally announced October 2022.
-
Procedural band patterns
Authors:
Jimmy Etienne,
Sylvain Lefebvre
Abstract:
We seek to cover a parametric domain with a set of evenly spaced bands which number and widthvaries according to a density field. We propose an implicit procedural algorithm, that generates theband pattern from a pixel shader and adapts to changes to the control fields in real time. Each band isuniquely identified by an integer. This allows a wide range of texturing effects, including specifying a…
▽ More
We seek to cover a parametric domain with a set of evenly spaced bands which number and widthvaries according to a density field. We propose an implicit procedural algorithm, that generates theband pattern from a pixel shader and adapts to changes to the control fields in real time. Each band isuniquely identified by an integer. This allows a wide range of texturing effects, including specifying adifferent appearance in each individual bands. Our technique also affords for progressive gradationsof scales, avoiding the abrupt doubling of the number of lines of typical subdivision approaches. Thisleads to a general approach for drawing bands, drawing splitting and merging curves, and drawingevenly spaced streamlines. Using these base ingredients, we demonstrate a wide variety of texturingeffects.
△ Less
Submitted 3 March, 2020;
originally announced March 2020.
-
Efficient Direct Slicing Of Dilated And Eroded 3d Models For Additive Manufacturing: Technical Report
Authors:
Sylvain Lefebvre
Abstract:
In the context of additive manufacturing we present a novel technique for direct slicing of a dilated or eroded volume, where the input volume boundary is a triangle mesh. Rather than computing a 3D model of the boundary of the dilated or eroded volume, our technique directly produces its slices. This leads to a computationally and memory efficient algorithm, which is embarrassingly parallel. Cont…
▽ More
In the context of additive manufacturing we present a novel technique for direct slicing of a dilated or eroded volume, where the input volume boundary is a triangle mesh. Rather than computing a 3D model of the boundary of the dilated or eroded volume, our technique directly produces its slices. This leads to a computationally and memory efficient algorithm, which is embarrassingly parallel. Contours can be extracted under an arbitrary chord error, non-uniform dilation or erosion are also possible. Finally, the scheme is simple and robust to implement.
△ Less
Submitted 14 November, 2019;
originally announced November 2019.
-
Planning Jerk-Optimized Trajectory with Discrete-Time Constraints for Redundant Robots
Authors:
Chengkai Dai,
Sylvain Lefebvre,
Kai-Ming Yu,
Jo M. P. Geraedts,
Charlie C. L. Wang
Abstract:
We present a method for effectively planning the motion trajectory of robots in manufacturing tasks, the tool-paths of which are usually complex and have a large number of discrete-time constraints as waypoints. Kinematic redundancy also exists in these robotic systems. The jerk of motion is optimized in our trajectory planning method at the meanwhile of fabrication process to improve the quality…
▽ More
We present a method for effectively planning the motion trajectory of robots in manufacturing tasks, the tool-paths of which are usually complex and have a large number of discrete-time constraints as waypoints. Kinematic redundancy also exists in these robotic systems. The jerk of motion is optimized in our trajectory planning method at the meanwhile of fabrication process to improve the quality of fabrication.
△ Less
Submitted 15 February, 2020; v1 submitted 14 September, 2019;
originally announced September 2019.
-
AI in the media and creative industries
Authors:
Giuseppe Amato,
Malte Behrmann,
Frédéric Bimbot,
Baptiste Caramiaux,
Fabrizio Falchi,
Ander Garcia,
Joost Geurts,
Jaume Gibert,
Guillaume Gravier,
Hadmut Holken,
Hartmut Koenitz,
Sylvain Lefebvre,
Antoine Liutkus,
Fabien Lotte,
Andrew Perkis,
Rafael Redondo,
Enrico Turrin,
Thierry Vieville,
Emmanuel Vincent
Abstract:
Thanks to the Big Data revolution and increasing computing capacities, Artificial Intelligence (AI) has made an impressive revival over the past few years and is now omnipresent in both research and industry. The creative sectors have always been early adopters of AI technologies and this continues to be the case. As a matter of fact, recent technological developments keep pushing the boundaries o…
▽ More
Thanks to the Big Data revolution and increasing computing capacities, Artificial Intelligence (AI) has made an impressive revival over the past few years and is now omnipresent in both research and industry. The creative sectors have always been early adopters of AI technologies and this continues to be the case. As a matter of fact, recent technological developments keep pushing the boundaries of intelligent systems in creative applications: the critically acclaimed movie "Sunspring", released in 2016, was entirely written by AI technology, and the first-ever Music Album, called "Hello World", produced using AI has been released this year. Simultaneously, the exploratory nature of the creative process is raising important technical challenges for AI such as the ability for AI-powered techniques to be accurate under limited data resources, as opposed to the conventional "Big Data" approach, or the ability to process, analyse and match data from multiple modalities (text, sound, images, etc.) at the same time. The purpose of this white paper is to understand future technological advances in AI and their growing impact on creative industries. This paper addresses the following questions: Where does AI operate in creative Industries? What is its operative role? How will AI transform creative industries in the next ten years? This white paper aims to provide a realistic perspective of the scope of AI actions in creative industries, proposes a vision of how this technology could contribute to research and development works in such context, and identifies research and development challenges.
△ Less
Submitted 10 May, 2019;
originally announced May 2019.
-
Printable Aggregate Elements
Authors:
Jérémie Dumas,
Jonàs Martínez,
Sylvain Lefebvre,
Li-Yi Wei
Abstract:
Aggregating base elements into rigid objects such as furniture or sculptures is a great way for designers to convey a specific look and feel. Unfortunately, there is no existing solution to help model structurally sound aggregates. The challenges stem from the fact that the final shape and its structural properties emerge from the arrangements of the elements, whose sizes are large so that they re…
▽ More
Aggregating base elements into rigid objects such as furniture or sculptures is a great way for designers to convey a specific look and feel. Unfortunately, there is no existing solution to help model structurally sound aggregates. The challenges stem from the fact that the final shape and its structural properties emerge from the arrangements of the elements, whose sizes are large so that they remain easily identifiable. Therefore there is a very tight coupling between the object shape, structural properties, and the precise layout of the elements.
We present the first method to create aggregates of elements that are structurally sound and can be manufactured on 3D printers. Rather than having to assemble an aggregate shape by painstakingly positioning elements one by one, users of our method only have to describe the structural purpose of the desired object. This is done by specifying a set of external forces and attachment points. The algorithm then automatically optimizes a layout of user-provided elements that answers the specified scenario. The elements can have arbitrary shapes: convex, concave, elongated, and can be allowed to deform.
Our approach creates connections between elements through small overlaps preserving their appearance, while optimizing for the global rigidity of the resulting aggregate. We formulate a topology optimization problem whose design variables are the positions and orientations of individual elements. Global rigidity is maximized through a dedicated gradient descent scheme. Due to the challenging setting -- number of elements, arbitrary shapes, orientation, and constraints in 3D -- we propose several novel steps to achieve convergence.
△ Less
Submitted 6 November, 2018;
originally announced November 2018.
-
Colored fused filament fabrication
Authors:
Haichuan Song,
Jonas Martinez,
Pierre Bedell,
Noemie Vennin,
Sylvain Lefebvre
Abstract:
Fused filament fabrication is the method of choice for printing 3D models at low cost and is the de-facto standard for hobbyists, makers, and schools. Unfortunately, filament printers cannot truly reproduce colored objects. The best current techniques rely on a form of dithering exploiting occlusion, that was only demonstrated for shades of two base colors and that behaves differently depending on…
▽ More
Fused filament fabrication is the method of choice for printing 3D models at low cost and is the de-facto standard for hobbyists, makers, and schools. Unfortunately, filament printers cannot truly reproduce colored objects. The best current techniques rely on a form of dithering exploiting occlusion, that was only demonstrated for shades of two base colors and that behaves differently depending on surface slope.
We explore a novel approach for 3D printing colored objects, capable of creating controlled gradients of varying sharpness. Our technique exploits off-the-shelves nozzles that are designed to mix multiple filaments in a small melting chamber, obtaining intermediate colors once the mix is stabilized.
We apply this property to produce color gradients. We divide each input layer into a set of strata, each having a different constant color. By locally changing the thickness of the stratum, we change the perceived color at a given location. By optimizing the choice of colors of each stratum, we further improve quality and allow the use of different numbers of input filaments.
We demonstrate our results by building a functional color printer using low cost, off-the-shelves components. Using our tool a user can paint a 3D model and directly produce its physical counterpart, using any material and color available for fused filament fabrication.
△ Less
Submitted 1 August, 2019; v1 submitted 27 September, 2017;
originally announced September 2017.
-
From 3D Models to 3D Prints: an Overview of the Processing Pipeline
Authors:
Marco Livesu,
Stefano Ellero,
Jonás Martìnez,
Sylvain Lefebvre,
Marco Attene
Abstract:
Due to the wide diffusion of 3D printing technologies, geometric algorithms for Additive Manufacturing are being invented at an impressive speed. Each single step, in particular along the Process Planning pipeline, can now count on dozens of methods that prepare the 3D model for fabrication, while analysing and optimizing geometry and machine instructions for various objectives. This report provid…
▽ More
Due to the wide diffusion of 3D printing technologies, geometric algorithms for Additive Manufacturing are being invented at an impressive speed. Each single step, in particular along the Process Planning pipeline, can now count on dozens of methods that prepare the 3D model for fabrication, while analysing and optimizing geometry and machine instructions for various objectives. This report provides a classification of this huge state of the art, and elicits the relation between each single algorithm and a list of desirable objectives during Process Planning. The objectives themselves are listed and discussed, along with possible needs for tradeoffs. Additive Manufacturing technologies are broadly categorized to explicitly relate classes of devices and supported features. Finally, this report offers an analysis of the state of the art while discussing open and challenging problems from both an academic and an industrial perspective.
△ Less
Submitted 21 September, 2017; v1 submitted 10 May, 2017;
originally announced May 2017.
-
Anti-aliasing for fused filament deposition
Authors:
Hai-Chuan Song,
Nicolas Ray,
Dmitry Sokolov,
Sylvain Lefebvre
Abstract:
Layered manufacturing inherently suffers from staircase defects along surfaces that are gently slopped with respect to the build direction. Reducing the slice thickness improves the situation but never resolves it completely as flat layers remain a poor approximation of the true surface in these regions. In addition, reducing the slice thickness largely increases the print time. In this work we fo…
▽ More
Layered manufacturing inherently suffers from staircase defects along surfaces that are gently slopped with respect to the build direction. Reducing the slice thickness improves the situation but never resolves it completely as flat layers remain a poor approximation of the true surface in these regions. In addition, reducing the slice thickness largely increases the print time. In this work we focus on a simple yet effective technique to improve the print accuracy for layered manufacturing by filament deposition. Our method works with standard three-axis 3D filament printers (e.g. the typical, widely available 3D printers), using standard extrusion nozzles. It better reproduces the geometry of sloped surfaces without increasing the print time. Our key idea is to perform a local anti-aliasing, working at a sub-layer accuracy to produce slightly curved deposition paths and reduce approximation errors. This is inspired by Computer Graphics anti-aliasing techniques which consider sub-pixel precision to treat aliasing effects. We show that the necessary deviation in height compared to standard slicing is bounded by half the layer thickness. Therefore, the height changes remain small and plastic deposition remains reliable. We further split and order paths to minimize defects due to the extruder nozzle shape, avoiding any change to the existing hardware. We apply and analyze our approach on 3D printed examples, showing that our technique greatly improves surface accuracy and silhouette quality while keeping the print time nearly identical.
△ Less
Submitted 10 April, 2017; v1 submitted 10 September, 2016;
originally announced September 2016.
-
Towards Zero-Waste Furniture Design
Authors:
Bongjin Koo,
Jean Hergel,
Sylvain Lefebvre,
Niloy J. Mitra
Abstract:
In traditional design, shapes are first conceived, and then fabricated. While this decoupling simplifies the design process, it can result in inefficient material usage, especially where off-cut pieces are hard to reuse. The designer, in absence of explicit feedback on material usage remains helpless to effectively adapt the design -- even though design variabilities exist. In this paper, we inves…
▽ More
In traditional design, shapes are first conceived, and then fabricated. While this decoupling simplifies the design process, it can result in inefficient material usage, especially where off-cut pieces are hard to reuse. The designer, in absence of explicit feedback on material usage remains helpless to effectively adapt the design -- even though design variabilities exist. In this paper, we investigate {\em waste minimizing furniture design} wherein based on the current design, the user is presented with design variations that result in more effective usage of materials. Technically, we dynamically analyze material space layout to determine {\em which} parts to change and {\em how}, while maintaining original design intent specified in the form of design constraints. We evaluate the approach on simple and complex furniture design scenarios, and demonstrate effective material usage that is difficult, if not impossible, to achieve without computational support.
△ Less
Submitted 31 March, 2016;
originally announced April 2016.