{"id":6105,"date":"2016-05-10T01:42:23","date_gmt":"2016-05-10T00:42:23","guid":{"rendered":"http:\/\/www.walkingrandomly.com\/?p=6105"},"modified":"2016-05-10T01:46:00","modified_gmt":"2016-05-10T00:46:00","slug":"may-23rd-2016-entropy-day-at-university-of-sheffield","status":"publish","type":"post","link":"https:\/\/walkingrandomly.com\/?p=6105","title":{"rendered":"May 23rd 2016: Entropy Day at University of Sheffield"},"content":{"rendered":"<p>I learned about <a href=\"https:\/\/en.wikipedia.org\/wiki\/Entropy\">entropy<\/a> as part of my undergraduate Physics education but it turns out that the concept of entropy turns up in many fields including\u00a0linguistics, themodynamics, information theory, chemistry and artificial intelligence.<\/p>\n<p>As part of Sheffield&#8217;s <a href=\"http:\/\/opendsi.cc\/\">Open Data Science Initiative<\/a>, computer scientist, <a href=\"http:\/\/inverseprobability.com\/\">Neil Lawrence<\/a>, has teamed up with linguist, <a href=\"https:\/\/www.sheffield.ac.uk\/russian\/staff\/profiles\/divjakd\">Dagmar Divjak<\/a>, to organise a cross-faculty discussion meeting on the subject of entropy.<\/p>\n<p>For more details on the day&#8217;s events, and to register, see\u00a0<a href=\"http:\/\/opendsi.cc\/ed2016\/program\">http:\/\/opendsi.cc\/ed2016\/program<\/a><\/p>\n<p><a href=\"http:\/\/opendsi.cc\/ed2016\/program\" rel=\"attachment wp-att-6109\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-medium wp-image-6109\" src=\"https:\/\/www.walkingrandomly.com\/wp-content\/uploads\/2016\/05\/entropy-300x94.png\" alt=\"entropy\" title=\"entropy\" width=\"300\" height=\"94\" srcset=\"https:\/\/walkingrandomly.com\/wp-content\/uploads\/2016\/05\/entropy-300x94.png 300w, https:\/\/walkingrandomly.com\/wp-content\/uploads\/2016\/05\/entropy.png 613w\" sizes=\"auto, (max-width: 300px) 100vw, 300px\" \/><\/a><\/p>\n<p>I wasted a little time producing the above logo for the event using <a href=\"http:\/\/www.wolfram.com\/mathematica\/\">Mathematica<\/a>.<\/p>\n<p> Here&#8217;s the source code:-<\/p>\n<pre>\r\n(*consider column one pixel at a time. Invert the pixel if a random number is below some threshold*)\r\nflipbit[col_, prob_] := Module[{result, temp, x},\r\n  result = col;\r\n  Do[\r\n   If[RandomReal[] <=  prob,\r\n    If[result[[x]] == 1, result[[x]] = 0, result[[x]] = 1];\r\n    ]\r\n   , {x, 1, Length[col]}\r\n   ];\r\n  \r\n  Return[result]\r\n  ]\r\n\r\ntext = \"Entropy\";\r\nimage = Rasterize[Text[Style[text, White, Italic, 190]], \r\n   Background -> Black];\r\nimageData = ImageData[Binarize[image]];\r\nconst = 1\/Dimensions[imageData][[2]]*0.42;\r\n(*Apply flipbit to all columns. Increase probability of flipping as you move along the x-axis*)\r\nlogo = \r\n  Transpose[\r\n   MapIndexed[flipbit[#1, const*#2[[1]]] &, Transpose[imageData]]];\r\nImage[logo]\r\n<\/pre>\n<p>Finally, I found this quote about entropy that I quite like:<\/p>\n<blockquote><p><b>You should call it <a class=\"extiw\" title=\"w:Entropy\" href=\"https:\/\/en.wikipedia.org\/wiki\/Entropy\">entropy<\/a><\/b>, for two reasons. In the first place your uncertainty function has been used in statistical mechanics under that <a class=\"mw-redirect\" title=\"Name\" href=\"https:\/\/en.wikiquote.org\/wiki\/Name\">name<\/a>, so it already has a name. <b>In the second place, and more important, no one really knows what entropy really is, so in a debate you will always have the advantage.<\/b><\/p>\n<p>John von Neumann to <a title=\"Claude Elwood Shannon\" href=\"https:\/\/en.wikiquote.org\/wiki\/Claude_Elwood_Shannon\">Claude Shannon<\/a> a name for his new uncertainty function. Source: <a href=\"https:\/\/en.wikiquote.org\/wiki\/John_von_Neumann\">Wikiquotes<\/a><\/p><\/blockquote>\n","protected":false},"excerpt":{"rendered":"<p>I learned about entropy as part of my undergraduate Physics education but it turns out that the concept of entropy turns up in many fields including\u00a0linguistics, themodynamics, information theory, chemistry and artificial intelligence. As part of Sheffield&#8217;s Open Data Science Initiative, computer scientist, Neil Lawrence, has teamed up with linguist, Dagmar Divjak, to organise a [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[8,78,79],"tags":[],"class_list":["post-6105","post","type-post","status-publish","format-standard","hentry","category-mathematica","category-open-data-science","category-university-of-sheffield"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_shortlink":"https:\/\/wp.me\/p3swhs-1At","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/walkingrandomly.com\/index.php?rest_route=\/wp\/v2\/posts\/6105","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/walkingrandomly.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/walkingrandomly.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/walkingrandomly.com\/index.php?rest_route=\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/walkingrandomly.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=6105"}],"version-history":[{"count":6,"href":"https:\/\/walkingrandomly.com\/index.php?rest_route=\/wp\/v2\/posts\/6105\/revisions"}],"predecessor-version":[{"id":6113,"href":"https:\/\/walkingrandomly.com\/index.php?rest_route=\/wp\/v2\/posts\/6105\/revisions\/6113"}],"wp:attachment":[{"href":"https:\/\/walkingrandomly.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=6105"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/walkingrandomly.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=6105"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/walkingrandomly.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=6105"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}