Artificial Intelligence | News | Insights | AiThority
[bsfp-cryptocurrency style=”widget-18″ align=”marquee” columns=”6″ coins=”selected” coins-count=”6″ coins-selected=”BTC,ETH,XRP,LTC,EOS,ADA,XLM,NEO,LTC,EOS,XEM,DASH,USDT,BNB,QTUM,XVG,ONT,ZEC,STEEM” currency=”USD” title=”Cryptocurrency Widget” show_title=”0″ icon=”” scheme=”light” bs-show-desktop=”1″ bs-show-tablet=”1″ bs-show-phone=”1″ custom-css-class=”” custom-id=”” css=”.vc_custom_1523079266073{margin-bottom: 0px !important;padding-top: 0px !important;padding-bottom: 0px !important;}”]

NextVPU breaks the Performance Records of AI Chips on the Edge Side, and supports “Algorithm Deployment Within 5 Minutes”

In less than five years after its establishment, NextVPU has reinforced its leading position in the computer vision industry. Its “blockbuster products” are N1 series computer vision chips. With the high Tera operations per second (TOPS) and powerful real-time data stream processing capability, N1 series chips support direct lossless deployment of the high-precision FP16 neural network model, high-performance INT8 network, multi-level fine-grain power control, and highly integrated design including dual-core CPU, ISP, Codec, DSP, rich peripherals etc, thereby continuously breaking the performance records of AI chips on the edge side and achieving almost “lossless” precision. In addition, NextVPU has launched an easy-use AI deployment software platform Infer Studio, which supports “5-minute deployment”. Infer Studio can directly resolve the pain points of enterprises that the Artificial Intelligence algorithms are difficult to be deployed.

N1 Series Chips’ Spec

As every device goes smart, AI technologies have turned from academic research into practical use and become the engine to help dozens of industries to “improve quality and increase efficiency”. Among all kinds of AI technologies, the computer vision AI technology is undoubtedly a breakthrough point to open the intelligent future. From driver assistance system to IoT equipment, from national economy to the people’s livelihood, computer vision has been widely used in various industries.

As a battleship in the deep sea of computer vision, NextVPU is building intelligent solutions from both the hardware and software sides based on its AI chip products and the algorithm deployment platform Infer Studio. With the help of the Infer Studio platform, NextVPU’s N1 series chips successfully support the simultaneous running of 11 AI algorithms in a consumer product.

Curiously, how is this result achieved? What benefits does the AI solution based on NextVPU’s N1 series chips and Infer Studio platform bring to customers? Among many AI chip players, what kind of product design ingenuity does NextVPU rely on to establish its own competitive edge?

Alan Feng, founder and CEO of NextVPU, unveiled the unique technologies of NextVPU’s computer vision AI chips and the Infer Studio platform.

Recommended AI News: Privitar Achieves Microsoft’s Co-Sell Ready Designation And Joins Microsoft Fast Track For ISVs Program

Computer Vision Solutions with Hardware and Software Integrated

As revealed by Alan Feng, NextVPU’s R&D team currently has more than 200 staff, of which the ratio of hardware engineers to software engineers is about 1:2.2. Based on the self-developed CVKit NN IP, NextVPU has developed an AI chip matrix for different market segments, such as camera, vehicle, 3D vision, and launched the AI application development platform Infer Studio.

In the AI chip matrix, NextVPU released three computer vision chips (N163, N161, and N160) this year to provide 2.4 TOPS, 1.2 TOPS, and 1 TOPS computing power, respectively. These chips can meet various requirements of machine vision, intelligent cameras, ADAS and AIoT markets. The Infer Studio platform can help customers who without AI-related experiences quickly deploy AI & vision algorithms.

As told by Alan Feng, NextVPU’s N1 series chips are not pure AI co-processors but highly integrated SoC chips, which are different from common computer vision chips on the market. This means that N1 series chips not only provide the basic computer vision chip functions such as signal sampling and signal processing, but also support more functions.

“Our chips adopt a very heterogeneous architecture. With excellent performance on signal sampling and signal processing, our chips also integrate a variety of peripheral interfaces and support many types of memory modules. Generally, N1 series chips are very comprehensive and robust SoCs”, he said.

In addition, Alan Feng shared his opinion that only a highly integrated computer vision SoC was not enough to meet the market demand and the efficiency of hardware support for AI algorithms needed to be improved to extend AI algorithms to practical applications. He said, “to put what customers’ desire into chips and selling them the chips is not realistic, and vendors actually need to bear a deep understanding of the applications and extension of AI algorithms.”

Infer Studio platform improves the efficiency of algorithm deployment by supporting not only neural network operations but also general mathematical methods. In practical applications, it would meet the requirements of fast iteration of user algorithms.

Recommended AI News: Silvaco Acquires Memory Compiler Technology Of Dolphin Design SAS

N1 Series Chips: Speed & Accuracy are the key performance metrics.

All AI applications are looking for ideal AI chips that achieve the balance among performance, power consumption, and cost. AI chips are measured from several aspects, such as the computing performance that can be obtained per dollar, the performance that can be obtained per kilowatt-hour (KWH) of electricity, the cost of algorithm deployment, and the stability and reliability of the chip itself. Among them, the computing power of each TOPS claimed by chip vendors corresponds to the actual number of frames processed per second (such as pictures or videos), and it is crucial to maintain the accuracy of the algorithm in the conversion from neural network model training to model deployment.

As shared by NextVPU, according to the test results of N161 chips on different neural networks, the number of pictures inferred by N161 chips per second per TOPS demonstrates an industry-leading level. In addition, the N161 chip also shows its robust performance on supporting the FP16 precision network.

When running neural network algorithms, benefiting from the brand-new architecture of CVKit™ NN IP, the CPU on the N161 chip does not participate in the calculation (the CPU usage is constantly less than 1%). Therefore, the computing power of the CPU has been completely reserved for customers to use.

Recommended AI News: QuoLab Technologies Announces Partnership With QGroup GmbH

In terms of computing performance, NextVPU recorded the running results of the N161 chip on 9 neural networks, and compared the result with an industry flagship chip on 5 neural networks.

Related Posts
1 of 40,726

As shown in the comparison results, the N161 chip outperforms the flagship chip on all 5 neural networks of ResNet-50, MobilleNetV1, MobilleNetV2, MobilleNetV1-SSD, and YOLOV3.

In addition to the computing performance, the computing precision is also a key indicator for measuring an AI chip. This is because the loss of accuracy caused by data type conversion will increase the cost in the process of neural network model training and deploying the model.

Taking Unmanned Retail Machine as an example, if the precision of the object(goods in this context) recognition algorithm decreases by 1% in actual application, the loss rate and the operation cost will increase significantly.

NextVPU recorded the test results of the N161 chip running on the 7 neural networks under the precision of PC NCNN FP32 and N161 board-level INT8, and calculated the precision loss when the model was quantized from FP32 to INT8.

According to the test results on the 7 networks, all the precision loss of N161 quantization from FP32 to INT8 is less than 1%. Therefore, the N161 chip supports the direct deployment of algorithm models on the FP16 network without precision loss.

Recommended AI News: PlaySight Announces Updated Product Portfolio With GO And PRO Sports Video Platforms  

Infer Studio: Resolving the Pain Points of Algorithm Deployment

The challenge of AI Deployment, on the one hand, is that the whole industry urgently requires “right” chips with excellent performance, cost, power consumption, on the other hand, to deploy the AI algorithm in the applications demands high cost caused for acquiring proper AI expertise and skills. Currently, the latter has become a growing problem for AI deployment in the whole industry.

To solve this problem, NextVPU has launched the AI application development platform Infer Studio. Infer Studio can “translate” an algorithm into a file that the chip can “read” so that the algorithm can be deployed quickly. In this way, it provides developers with “one-click” development experience.

Taking an ADAS(Advanced Driver Assistance System) project as an example, in order to monitor whether a driver talks, phones, or dozes when driving a vehicle, the system needs to monitor the driver’s eye status and whether the driver has a phone by his or her ear. Generally, it takes at least one week to deploy such an algorithm into the embedded system. In contrast, with the help of the Infer Studio development platform, the algorithm can be compiled and deployed into the device quickly.

In this process, through the binding of modules, developers can flexibly combine functional modules based on their own application requirements, or delete, replace, and add some algorithm modules as required. All pipeline building work can be achieved through visualization or the configuration of a few lines of code, significantly reducing the time on developing the AI algorithm.

In addition to vehicle scenarios, the Infer Studio™ development platform can also accelerate the process of algorithm compilation to application deployment for application scenarios such as object classification, face recognition, vehicle detection, and object segmentation, etc.

Recommended AI News: Nightfall AI Joins CircleCI’s Partner Network To Bring Data Loss Prevention To Code Commits

What black technologies does NextVPU provide to support the “one-click” development experience on Infer Studio?

The Infer Studio development platform supports mainstream frameworks such as TensorFlow, TensorFlow Lite, ONNX, and Caffe so that developers can choose them as required. On the software layer, Infer Studio provides four function modules: Model Visualization, Compiler, Evaluator, and Debugger.

The Model Visualization module can convert the complex code of the algorithm network on the PC side into a network diagram so that developers can analyze the structure and attributes of the network intuitively.

The Compiler module can convert the algorithms developed based on the mainstream AI framework into files that can be read by AI chips, and complete the function of Compression at the same time. It further reduces the size of the algorithm model so that the algorithm can be deployed on the terminal devices with limited storage space, improving the network inference performance.

In addition, Compiler supports optimization options such as operator fusion and precompilation, further enhancing the inference performance to AI chips.

The Evaluator module can quickly evaluate whether an algorithm runs correctly on the AI chip and whether the chip’s computing capability is fully utilized. In addition, it can visually present the algorithm effect of the network on the tested images through classification, detection, and segmentation.

The Debugger module can efficiently analyze the deviation and compatibility problems that may be encountered in the process of algorithm porting from PC to the embedded system. Users can export data of each layer in the operation of the algorithm and compare it with the corresponding layer of the original algorithm so that errors can be found and debugged at any time.

In addition, NextVPU provides technical support to customers according to their requirements in the implementation process of N1 series chips. “We maintain a very close interaction with our customers, and we have integrated many of their requirements into our chips and software tools,” Alan Feng said.

Recommended AI News: Code42 Incydr Delivers Evolved Data Protection For Channel Partners

46 Comments
  1. Doreen says

    Asking questions are really nice thing if you are not understanding something entirely, but this piece of writing offers pleasant understanding yet.

  2. I don’t even know the way I ended up here, however I assumed this post was once good.
    I don’t realize who you might be however definitely
    you’re going to a famous blogger in case you aren’t already.
    Cheers!

  3. benzac kopen in Zwitserland says

    Hi there! I just wanted to ask if you ever have any trouble with hackers?
    My last blog (wordpress) was hacked and I ended up losing several weeks of
    hard work due to no data backup. Do you have any solutions to prevent hackers?

  4. Hello there! This post could not be written much better! Looking through this article
    reminds me of my previous roommate! He continually kept talking about this.

    I most certainly will forward this article to him. Fairly certain he’s going to
    have a good read. Many thanks for sharing!

  5. Incredible points. Sound arguments. Keep up the great effort.

  6. If you wish for to take a good deal from this paragraph then you have to apply these strategies to your won webpage.

  7. Pretty! This was an extremely wonderful post. Thank you for supplying this info.

  8. Hello there, You have done a great job. I’ll definitely digg it and personally suggest to my friends.
    I am confident they’ll be benefited from this web site.

  9. Gennie says

    I delight in, cause I found just what I used to be taking a look for.
    You’ve ended my 4 day long hunt! God Bless you man. Have a great day.

    Bye

  10. Sweet blog! I found it while browsing on Yahoo News.

    Do you have any tips on how to get listed in Yahoo News?
    I’ve been trying for a while but I never seem to get there!
    Thanks

  11. Ernestina says

    I am sure this article has touched all the internet
    visitors, its really really pleasant post on building up new web site.

  12. Awesome blog! Do you have any tips for aspiring writers?
    I’m planning to start my own website soon but I’m a little lost on everything.
    Would you advise starting with a free platform like WordPress or go for a paid option? There are
    so many options out there that I’m completely confused ..
    Any recommendations? Appreciate it!

  13. Isabella Miller says

    In reality, it’s likely that personal values result from a combination of innate predispositions and external influences The developmental process of values is dynamic, with both nature and nurture contributing to an individual’s moral and ethical framework.

  14. Sell copper scrap says

    Copper scrap warehousing Copper scrap chemical treatment Scrap metal recycling industry
    Copper cable scrap export documentation, Scrap metal inventory tracking, Copper scrap inventory

  15. I really love your website.. Excellent colors & theme.
    Did you build this site yourself? Please reply back as I’m trying to create my own site and would like to learn where you got this from or what
    the theme is named. Thanks!

  16. It’s very trouble-free to find out any matter on web as compared
    to textbooks, as I found this paragraph at this site.

  17. MilaRT says

    I want to make you feel good so come check my free online live webcams out baby

  18. москва ул мясницкая дом 7 стр работа сбербанка суббота москва расстояние от москвы
    до коврова владимирской области на машине где купить азербайджанское вино в москве

  19. medicijnen: Hoe te gebruiken en bijwerkingen almus Calamar leki do kupienia bez problemów

  20. achat de amaryl en France says

    Online medicijnen bestellen in Tilburg was nog nooit zo eenvoudig.
    Teva Sarnen Puedo comprar medicamentos sin receta en Lima

  21. farmaci senza consultazione del medico AAA-Pharma Chillan Kauf von schlaffördernden Medikamenten

  22. medicamentos en venta libre en Portugal Basi Florenville
    medicijnen zonder bijwerkingen

  23. ordenar medicamentos en Bélgica 1A Pharma Villagarzón médicaments en vente libre dans certaines régions de France

  24. tiasar kaufen günstig says

    médicaments en pharmacie en ligne : une solution pratique Labesfal Sonsón Doe een bestelling van medicijnen in Nederland

  25. снится авария на самолете обряд приворота в домашних условиях мужчины хочет вернуться к бывшей жене гадание
    действительно ли действуют заговоры к чему снится персонаж книги

  26. Thanks in support of sharing such a fastidious opinion, piece of writing is fastidious, thats why i have
    read it fully

  27. Undeniably consider that which you said. Your favourite reason appeared to be at the
    net the simplest thing to bear in mind of. I say
    to you, I certainly get annoyed whilst people
    think about concerns that they plainly do not know about.
    You managed to hit the nail upon the top and outlined out the
    entire thing without having side-effects , other folks can take a signal.
    Will probably be back to get more. Thank you

  28. шармы пандора, шармы пандора каталог мрт головного мозга алматы,
    мрт головного мозга с контрастом алматы алланы естен шығармайтын қыз скачать, қыз туып берші маған скачать ерулік сипаттама құндылығы мен маңызы, асар құндылығы мен маңызы

  29. wo man Medikamente in der Schweiz findet Janssen Geldenaken bestel medicijnen in Nederland

  30. farmaci da banco in Portogallo Actavis La Tebaida achat de médicaments
    en Italie en ligne

  31. Medikamente problemlos in Belgien kaufen Normon Kaiserslautern achat
    de médicaments en ligne sécurisé

  32. не пайда нұр мұқасан, не пайда скачать терме шишканы қалай
    кетіруге болады, уколдан кейинги абсцесс қр қаржы құқығы, бюджет құқығы онлайн мастер класс по тортам

  33. біріккен сөздер 4 сынып 53 сабақ, біріккен сөздер
    мысал верховная жрица описание женщины,
    верховная жрица описание человека қауын түрлері, кауын аттары аевит цена павлодар, аевит для лица цена

  34. Real Kevin says

    We can both make ourselves horny first. I’ll tell you what I’m doing and where my hands are at the moment or you can guide my hand to the place where you’d like to have yours. While I do it myself, you can natural cam girls your cock and tell me how horny you are.

  35. Carrie says

    I am young and dirty and I think quite nice to look at. My tits are natural and my nipples are real cams show. Hehe now don’t keep me waiting and let’s go before someone else does and calls me.

  36. sapphire rx 580 bios says

    что означает число 2313 9 земли манара чувства
    мужчины рассказ о князе владимире 4 класс кратко,
    правление князя владимира крещение руси кратко
    сонник началась война самолеты заговор
    читают на новый кошелек степанова

  37. почему не приходят смс на кнопочный телефон, как зарегистрировать номер на телефон
    бөліп шығарушы ұлпа презентация,
    шірнеліктер коньки спорты презентация қазақша, коньки спорты
    алаңды бұрыла сырғанау қоғам және мәдениет реферат, қоғам
    және мәдениет философиясы презентация

  38. Gracie Mae says

    I really like men who know what they want) & am looking forward to horny conversations! If you like hot cam girls blondes with big breasts, you’ve come to the right place.

  39. MilaRT says

    soy una chica simpatica, me free online live s** chat rooms conocer gente y reir mucho.

  40. My brother suggested I might like this website.

    He was totally right. This post truly made my day. You
    can not imagine simply how much time I had spent for this information! Thanks!

  41. леомакс работа на дому отзывы видео уроки для начинающих
    работа в доме отдыха нижний новгород подработка
    на выходные белгород с ежедневной
    оплатой

  42. к чему снится когда кусает варан сколько высыхает
    вода, за сколько высыхают волосы к
    чему снятся большие аквариумные рыбы
    свеча за здравие врагов видимых и невидимых матрица судьбы значение всех чисел

  43. дом работа дом скачать подработка электрика хабаровск
    подработка грузчик экспедитор с ежедневной оплатой
    подработка в озон удаленно
    с карточками

  44. жалпы оним, жалпы ішкі өнім на русском абайдың толық адам ілімі кітабы saktagan, казахстанский джип
    аналар үйі талдықорған адрес, ана мен бала уйи алматы

  45. Medikamente online kaufen in Spanien Bluefish Olavarría Trouvez votre dose de médicaments en ligne

  46. Freiverkäufliches Medikamente Hormona Bollate compra medicamentos en línea

Leave A Reply

Your email address will not be published.