{"id":17786,"date":"2022-10-30T17:39:44","date_gmt":"2022-10-30T21:39:44","guid":{"rendered":"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/?p=17786"},"modified":"2026-03-27T08:50:25","modified_gmt":"2026-03-27T12:50:25","slug":"part-3-the-2022-wilson-research-group-functional-verification-study","status":"publish","type":"post","link":"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/10\/30\/part-3-the-2022-wilson-research-group-functional-verification-study\/","title":{"rendered":"Part 3: The 2022 Wilson Research Group Functional Verification Study"},"content":{"rendered":"\n<p>This blog is a continuation of a series of blogs related to the&nbsp;<a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/10\/10\/prologue-the-2022-wilson-research-group-functional-verification-study\/\">2022 Wilson Research Group Functional Verification Study<\/a>.&nbsp; In my <a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/10\/24\/part-2-the-2022-wilson-research-group-functional-verification-study\/\">previous blog<\/a>, I presented the findings from our new study related to how successful FPGA projects are in terms of verification effectiveness. In this blog I focus on FPGA verification effort trends.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>FPGA Verification Effort Trends<\/strong><\/h2>\n\n\n\n<p>Directly asking study participants how much effort they spend in verification will not work. The reason is that it\u2019s hard to find a paper or article on verification that doesn\u2019t start with the phrase: \u201cSeventy percent of a project\u2019s effort is spent in verification\u2026\u201d In other words, the industry is already biased to respond with this effort value. Yet, there are really no creditable references to quantify this value.<\/p>\n\n\n\n<p>I don\u2019t believe that there is a simple answer to the question, \u201cHow much effort was spent on verification in your last project?\u201d In fact, I believe that it is necessary to look at multiple data points derived from multiple questions to truly get a sense of effort spent in verification. And that\u2019s what we did in our functional verification study.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Percentage of Project Time Spent in Verification<\/strong><\/h2>\n\n\n\n<p>To try to assess the effort spent in verification, let\u2019s begin by looking at one data point, which is the total project time spent in verification, as shown in Fig. 3-1. You can see two extremes in this graph. In general, projects that spend very little time in verification are typically working on designs with a good deal of existing pre-verified design IP, which is integrated to create a new product. On the other extreme, projects that spend a significant amount of time in verification often have a high percentage of newly developed design IP that must be verified.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/blogs.sw.siemens.com\/wp-content\/uploads\/sites\/54\/2022\/10\/2022-03-01-1024x576.png\" alt=\"\" class=\"wp-image-17788\" srcset=\"https:\/\/blogs.sw.siemens.com\/wp-content\/uploads\/sites\/54\/2022\/10\/2022-03-01-1024x576.png 1024w, https:\/\/blogs.sw.siemens.com\/wp-content\/uploads\/sites\/54\/2022\/10\/2022-03-01-600x338.png 600w, https:\/\/blogs.sw.siemens.com\/wp-content\/uploads\/sites\/54\/2022\/10\/2022-03-01-768x432.png 768w, https:\/\/blogs.sw.siemens.com\/wp-content\/uploads\/sites\/54\/2022\/10\/2022-03-01-395x222.png 395w, https:\/\/blogs.sw.siemens.com\/wp-content\/uploads\/sites\/54\/2022\/10\/2022-03-01-900x506.png 900w, https:\/\/blogs.sw.siemens.com\/wp-content\/uploads\/sites\/54\/2022\/10\/2022-03-01.png 1280w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Fig. 3-1. Percentage of FPGA project time spent in verification<\/figcaption><\/figure>\n\n\n\n<p>Overall, we found a slight decline in a project time spent in FPGA verification 2022, which is somewhat of a surprise due to growing complexity.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\"><strong>Peak Number of Design and Verification Engineers<\/strong><\/h2>\n\n\n\n<p>Perhaps one of the biggest challenges today is to control cost and engineering headcount, which means identifying FPGA design and verification solutions that increase productivity. To illustrate the need for productivity improvement, we discuss the trend in terms of increasing engineering headcount. Fig. 3-2 shows the mean peak number of FPGA engineers working on a project.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"576\" src=\"https:\/\/blogs.sw.siemens.com\/wp-content\/uploads\/sites\/54\/2022\/10\/2022-03-02-1024x576.png\" alt=\"\" class=\"wp-image-17789\" srcset=\"https:\/\/blogs.sw.siemens.com\/wp-content\/uploads\/sites\/54\/2022\/10\/2022-03-02-1024x576.png 1024w, https:\/\/blogs.sw.siemens.com\/wp-content\/uploads\/sites\/54\/2022\/10\/2022-03-02-600x338.png 600w, https:\/\/blogs.sw.siemens.com\/wp-content\/uploads\/sites\/54\/2022\/10\/2022-03-02-768x432.png 768w, https:\/\/blogs.sw.siemens.com\/wp-content\/uploads\/sites\/54\/2022\/10\/2022-03-02-395x222.png 395w, https:\/\/blogs.sw.siemens.com\/wp-content\/uploads\/sites\/54\/2022\/10\/2022-03-02-900x506.png 900w, https:\/\/blogs.sw.siemens.com\/wp-content\/uploads\/sites\/54\/2022\/10\/2022-03-02.png 1280w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption class=\"wp-element-caption\">Fig. 3-2. Mean Peak Number of FPGA Engineers Working on a Project<\/figcaption><\/figure>\n\n\n\n<p>While, on average, the demand for FPGA design engineers increased by 18% between 2012 and 2022, the demand for FPGA verification engineers increased at 38%. It is worth noting that during the period 2007 through 2014, the ASIC market went through similar growth demands related to verification engineers to address growing ASIC verification complexity.<\/p>\n\n\n\n<p>In my next blog I focus on the time that FPGA design and verification engineers spend in various task.<\/p>\n\n\n\n<p><strong>Quick links to the 2022 Wilson Research Group Study results<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/10\/10\/prologue-the-2022-wilson-research-group-functional-verification-study\/\" data-type=\"URL\" data-id=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/10\/10\/prologue-the-2022-wilson-research-group-functional-verification-study\/\">Prologue: The 2022 Wilson Research Group Functional Verification Study<\/a><\/li>\n\n\n\n<li>P<a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/10\/16\/part-1-the-2020-wilson-research-group-functional-verification-study-2\/\" data-type=\"URL\" data-id=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/10\/16\/part-1-the-2020-wilson-research-group-functional-verification-study-2\/\">art 1 \u2013 FPGA Design Trends<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/10\/24\/part-2-the-2022-wilson-research-group-functional-verification-study\/\" data-type=\"URL\" data-id=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/10\/24\/part-2-the-2022-wilson-research-group-functional-verification-study\/\">Part 2 \u2013 FPGA Verification Effectiveness Trends<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/10\/30\/part-3-the-2022-wilson-research-group-functional-verification-study\/\" data-type=\"URL\" data-id=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/10\/30\/part-3-the-2022-wilson-research-group-functional-verification-study\/\">Part 3 \u2013 FPGA Verification Effort Trends<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/11\/06\/part-4-the-2022-wilson-research-group-functional-verification-study\/\">Part 4 \u2013 FPGA Verification Effort Trends (Continued)<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/11\/13\/part-5-the-2022-wilson-research-group-functional-verification-study\/\">Part 5 \u2013 FPGA Verification Technology Adoption Trends<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/11\/21\/part-6-the-2022-wilson-research-group-functional-verification-study\/\">Part 6 \u2013 FPGA Verification Language and Library Adoption Trends<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/11\/28\/part-7-the-2022-wilson-research-group-functional-verification-study\/\" data-type=\"URL\" data-id=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/11\/28\/part-7-the-2022-wilson-research-group-functional-verification-study\/\">Part 7 \u2013 IC\/ASIC Design Trends<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/12\/12\/part-8-the-2022-wilson-research-group-functional-verification-study\/\" data-type=\"URL\" data-id=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/12\/12\/part-8-the-2022-wilson-research-group-functional-verification-study\/\">Part 8 \u2013 IC\/ASIC Resource Trends<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/12\/18\/part-9-the-2020-wilson-research-group-functional-verification-study-2\/\" data-type=\"URL\" data-id=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/12\/18\/part-9-the-2020-wilson-research-group-functional-verification-study-2\/\">Part 9 \u2013 IC\/ASIC Verification Technology Adoption Trends<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2022\/12\/26\/strongpart-10-the-2022-wilson-research-group-functional-verification-study-strong\/\" data-type=\"post\" data-id=\"17976\">Part 10 \u2013 IC\/ASIC Language and Library Adoption Trends<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2023\/01\/02\/part-11-the-2022-wilson-research-group-functional-verification-study\/\" data-type=\"URL\" data-id=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2023\/01\/02\/part-11-the-2022-wilson-research-group-functional-verification-study\/\">Part 11 \u2013 IC\/ASIC Power Management Trends<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2023\/01\/09\/part-12-the-2020-wilson-research-group-functional-verification-study-2\/\" data-type=\"URL\" data-id=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2023\/01\/09\/part-12-the-2020-wilson-research-group-functional-verification-study-2\/\">Part 12 \u2013 IC\/ASIC Verification Results Trends<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2023\/01\/15\/conclusion-the-2022-wilson-research-group-functional-verification-study\/\" data-type=\"URL\" data-id=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2023\/01\/15\/conclusion-the-2022-wilson-research-group-functional-verification-study\/\">Conclusion: The 2022 Wilson Research Group Functional<\/a><\/li>\n\n\n\n<li><a href=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2023\/01\/23\/epilogue-the-2022-wilson-research-group-functional-verification-study\/\" data-type=\"URL\" data-id=\"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/2023\/01\/23\/epilogue-the-2022-wilson-research-group-functional-verification-study\/\">Epilogue: The 2022 Wilson Research Group Functional<\/a><\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>This blog is a continuation of a series of blogs related to the&nbsp;2022 Wilson Research Group Functional Verification Study.&nbsp; In&#8230;<\/p>\n","protected":false},"author":71592,"featured_media":17792,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spanish_translation":"","french_translation":"","german_translation":"","italian_translation":"","polish_translation":"","japanese_translation":"","chinese_translation":"","footnotes":""},"categories":[1],"tags":[496,501,506,851],"industry":[32,45,53],"product":[205],"coauthors":[967],"class_list":["post-17786","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-news","tag-fpga","tag-fpga-verification","tag-functional-verification","tag-wilson-research-group-functional-verification-study","industry-aerospace-defense","industry-consumer-products-retail","industry-electronics-semiconductors","product-questa"],"featured_image_url":"https:\/\/blogs.sw.siemens.com\/wp-content\/uploads\/sites\/54\/2022\/10\/2022-03-00.png","_links":{"self":[{"href":"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/wp-json\/wp\/v2\/posts\/17786","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/wp-json\/wp\/v2\/users\/71592"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/wp-json\/wp\/v2\/comments?post=17786"}],"version-history":[{"count":5,"href":"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/wp-json\/wp\/v2\/posts\/17786\/revisions"}],"predecessor-version":[{"id":18145,"href":"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/wp-json\/wp\/v2\/posts\/17786\/revisions\/18145"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/wp-json\/wp\/v2\/media\/17792"}],"wp:attachment":[{"href":"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/wp-json\/wp\/v2\/media?parent=17786"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/wp-json\/wp\/v2\/categories?post=17786"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/wp-json\/wp\/v2\/tags?post=17786"},{"taxonomy":"industry","embeddable":true,"href":"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/wp-json\/wp\/v2\/industry?post=17786"},{"taxonomy":"product","embeddable":true,"href":"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/wp-json\/wp\/v2\/product?post=17786"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/blogs.sw.siemens.com\/verificationhorizons\/wp-json\/wp\/v2\/coauthors?post=17786"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}